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PREFACE 


This  work  documented  in  this  report  was  part  of  the  “Analyses  of  the  Soldier 
Machine  Interface  Issues  of  Future  Combat  Systems”  task  performed  for  Future  Combat 
Systems  (FCS)  Program  Manager  (PM),  Defense  Advanced  Research  Project  Agency 
(DARPA)  Tactical  Technology  Office  (TTO).  Technical  cognizance  for  the  work  was 
assigned  to  COL  William  Johnson,  FCS  PM.  The  Institute  for  Defense  Analyses  (IDA) 
Point  of  Contact  (POC)  was  Dr.  Peter  Brooks. 
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EXECUTIVE  SUMMARY 


INTRODUCTION 

The  Future  Combat  Systems  (FCS)  effort  employs  “leap-ahead”  technologies  and 
concepts  to  provide  unprecedented  levels  of  situational  understanding  and  synchroniza¬ 
tion  of  effects.  The  same  high  level  of  technical  sophistication  used  to  develop  FCS 
hardware  and  software  should  apply  to  the  development  of  the  soldier-machine  interface 
(SMI).  Guidance  is  needed  to  ensure  that  FCS  SMI  design  is  a  soldier-centered  process 
that  accommodates  a  system-of-systems  approach  to  warfighting;  includes  all  soldiers, 
mounted  and  dismounted;  and  is  effective  across  the  full  spectrum  of  warfare. 

REVIEW  OF  THE  LITERATURE 

Several  common  themes  unite  contemporary  design  philosophies.  One  is  that 
effective  interactive  designs  are  multimodal,  thereby  taking  advantage  of  known  efficien¬ 
cies  in  human  memory,  cognition,  and  performance.  Another  is  that  development  should 
be  iterative  to  match  products  to  requirements  more  closely.  The  iterative  redesign  pro¬ 
cess  should  be  based  on  soldier  feedback.  Also,  usability  should  affect  each  stage  of 
development.  Prototypical  users  [e.g.,  subject  matter  experts  (SMEs),  warfighters]  should 
determine  what  is  usable,  in  keeping  with  demands  from  leadership,  the  environment,  and 
unknown  factors. 

For  specific  guidance,  approximately  300  documents  were  retrieved  and  orga¬ 
nized  into  a  database.  Five  military  documents  were  identified  as  being  key  to  SMI 
design:  MIL-STD-1472F,  MIL-STD-2525B,  MIL-STD-41  IF,  North  Atlantic  Treaty 
Organization  (NATO)  Standardization  Agreement  (STANAG)  2019  (North  Atlantic 
Treaty  Organization,  1990),  and  an  Army  Research  Institute  (ARI)  technical  report  on 
human-factors  guidelines  for  command  and  control  (C2)  systems  (Lewis  and  Fallesen, 
1989).  Guidance  offered  in  these  documents  converged  on  highly  structured  rules  (e.g., 
font  size  or  window  placement)  that  resembled  instructions  or  directions  more  than  gen¬ 
eral  guidelines.  The  academic  and  industry  literature  was  more  heterogeneous,  and  it 
diverged  into  broad  philosophical  issues,  such  as  “design  as  engineering”  vs.  “design  as 
art”  and  the  utility  of  controlled  studies  or  usability  studies.  In  both  the  military  and 
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academic  domains,  interfaces  were  largely  concerned  with  visual  representations.  The 
academic  literature  also  revealed  some  recurring  themes  (e.g.,  promoting  iterative  proto¬ 
typing)  and  some  general  guidelines  for  interface  design  (e.g.,  understand  users  and  their 
tasks  and  use  consistent  display  formats,  language,  labels,  and  system  operation  proce¬ 
dures  throughout  the  course  of  the  dialogue). 

Ten  actual  digital  interfaces  that  have  been  used  in  virtual,  live,  or  operational 
environments  were  identified  and  discussed.  Each  provides  real-time  command,  control, 
communications,  computer,  intelligence,  surveillance,  and  reconnaissance  (C4ISR)  infor¬ 
mation  to  individual  platforms.  These  projects  cover  almost  20  years  of  research  and 
development  (R&D),  including  examples  such  as  the  InterVehicular  Information  System 
(IVIS),  which  was  developed  in  the  1980s  and  implemented  in  variants  of  the  Ml-series 
tank;  the  Force  XXI  Battle  Command  Battalion/Brigade  and  Below  (FBCB2)  applique, 
which  was  appended  to  a  variety  of  vehicles;  and  the  Warfighter-Machine  Interface 
(WMI),  which  was  proposed  for  the  evolving  FCS  platforms.  Several  generalizations  and 
trends  were  noted  across  the  interfaces: 

•  Terrain.  Terrain  is  central  to  all  reviewed  interfaces.  Also,  the  representation 
of  the  terrain  has  become  increasingly  sophisticated. 

•  Display  technology.  Display  technology  continues  to  focus  on  video  moni¬ 
tors.  There  has  been  less  interest  non  visual  input  approaches  (e.g.,  tactile, 
aural  displays)  and  no  apparent  interest  in  displays  based  on  chemical  senses 
(e.g.,  taste  and  smell). 

•  Control  technology.  Control  technology  focuses  on  conventional  manual 
devices.  Most  employ  technologies  borrowed  from  personal  computers  (e.g., 
keyboard,  mouse),  with  some  emerging  interest  in  voice  recognition  and  eye 
tracking  as  control  devices.  However,  established  oral  control  devices,  such 
as  mouthsticks,  are  not  being  considered. 

•  Intelligent  agents.  Intelligent  agents  are  beginning  to  emerge  as  important 
components  of  interfaces.  They  have  been  use  to  pre-process  information 
presented  to  user  and  to  configure  displays  automatically. 

DESIGN  MODEL 

The  model  that  was  devised  to  guide  the  interface  design  process  was  based  on 
several  assumptions  and  considerations  concerning  human  capabilities  and  limitations: 

•  The  interface  must  be  designed  to  conserve  mental  resources. 

•  The  interface  must  address  display  and  control  functions. 
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•  The  interface  must  promote  a  shared  understanding  among  echelons,  which 
is  not  a  necessary  result  of  sharing  a  common  operational  picture. 

•  The  interface  must  address  the  special  problems  of  the  dismount  to  exploit 
the  full  value  of  Network  Centric  Warfare  (NCW). 

The  model  was  also  constrained  by  proposed  PCS  concepts  and  the  environment 
within  which  the  system  will  operate.  In  particular,  the  PCS  interface  design  is  envi¬ 
sioned  to  be  a  multiechelon,  user-centered  process  that  balances  operational  variables 
with  the  four-dimensional  (4-D)  battlespace  (i.e.,  including  time),  employs  appropriate 
sensory  and  response  modalities  to  optimize  performance,  and  develops  innovative  and 
eclectic  display  and  control  methods. 

The  resulting  model  (see  Pigure  ES-1)  is  based  on  the  interaction  among  four  sets 
of  variables: 

1 .  Operational  variables 

2.  Battlespace 

3.  Sensor  modalities 

4.  Echelon. 

The  ordinate  depicts  information-processing  capabilities  along  a  continuum,  with  selected 
modalities  placed  in  relative  order  of  evolutionary  sophistication.  The  abscissa  depicts 
increasing  battlespace  complexity  and  time  available  that  are  associated  with  successive 
echelon  levels.  The  notional  curve  represents  increasing  organizational  echelon  and  pro¬ 
cessing  complexity.  Whereas  the  exact  shape  of  the  relation  is  unknown,  we  postulate 
that  it  is  monotonically  increasing  [higher  echelons  benefit  from  high-bandwidth  pro¬ 
cessing  modalities  (e.g.,  vision),  whereas  lower  echelons  benefit  from  less  sophisticated 
but  faster  responding  modalities  (e.g.,  olfactory  cues)].  Eurthermore,  the  relation  is 
thought  to  be  discontinuous,  with  the  relationship  differing  between  mounted  and  dis¬ 
mounted  warfighters.  Mounted  warfighters  benefit  disproportionately  from  the  higher 
modes  of  processing,  whereas  dismounted  warfighters  benefit  the  most  from  more  primi¬ 
tive  modes.  The  model  presented  in  Eigure  ES-1  is  highly  aggregated  and  simplified  ver¬ 
sion  of  an  n-dimensional  relationship.  Euture  research  should  isolate  and  validate  some  of 
the  fundamental  relationships  that  this  model  implies. 
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Figure  ES-1.  Design  Modei  for  FCS  interface 

Despite  the  tentative  nature  of  the  model,  it  can  be  used  for  devising  FCS  design 
guidelines.  For  instance,  the  model  suggests  the  following  design  principles: 

•  The  high-definition  visual  displays  designed  for  high-echelon  staff  members 
are  not  appropriate  for  lower  echelons  (especially  for  dismounted  soldiers). 
In  other  words,  dismounted  infantry  will  require  nonvisual  and  nonauditory 
displays  and  controls. 

•  Auditory,  haptic  information  should  be  pushed  down  the  echelon  to  augment 
the  highly  detailed  terrain  information  available  to  the  dismounted  war¬ 
fighter. 

•  Detailed  terrain  information  and  other  mission-related  information  available 
to  dismounted  warfighters  should  be  pushed  up  to  augment  visual  displays 
available  at  higher  echelons. 

•  The  auditory  modality  may  provide  the  common  link  across  echelons. 

•  Visual  displays  might  be  appropriate  to  all  echelons  during  planning,  when 
all  warfighters  have  increased  time  to  process  data.  Such  displays  are  not 
appropriate  for  lower-echelon  warfighters  during  execution  phases. 
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I.  INTRODUCTION 


A.  BACKGROUND 

Future  conflicts  will  be  fought  in  increasingly  dynamic,  nonlinear,  and  unpredict¬ 
able  battlespaces  that  are  populated  with  authoritarian  regimes  and  criminal  interests 
armed  with  asymmetric  capabilities  and  weapons  of  mass  destruction  (WMD).  To  meet 
this  multidimensional  challenge,  the  Chairman  of  the  Joint  Chiefs  of  Staff  (CJCS,  2000) 
issued  his  vision,  articulated  in  Joint  Vision  2020  (JV  2020),  which  seeks  to  transform  the 
U.S.  military  into  a  force  that  is  dominant  across  the  full  spectrum  of  military  operations. 
JV  2020  identifies  two  key  enablers  of  this  transformation:  information  and  innovation. 
Information  provides  the  primary  weapon  against  the  uncertainty  of  future  battlespaces. 
Information  is  also  the  necessary  requirement  for  decision  superiority— the  ability  to 
make  better  and  faster  decisions  than  the  enemy.  Innovation  refers  to  the  development  of 
new  technologies,  new  ideas,  and  new  concepts.  The  unorthodox  and  dangerous  nature  of 
evolving  threats  must  be  met  with  audacious  research  and  development  (R&D)  programs 
that  seek  true  leap-ahead  advances  in  technological  and  doctrinal  capabilities. 

1.  Network  Centric  Warfare  (NCW) 

To  translate  information  superiority  into  combat  power,  military  thinkers  are 
developing  the  construct  of  NCW,  which  provides  a  high-level  system  of  Information 
Age  constructs  for  integrating  vast  bodies  of  information  and  disparate  capabilities  into  a 
system  of  decentralized  and  autonomous  networks.  By  introducing  Information  Age  con¬ 
cepts  and  technologies  into  warfare,  these  thinkers  intend  to  foster  a  revolution  in  warfare 
analogous  to  the  ongoing  revolution  in  business  and  commerce  (e.g.,  Kelly,  1998). 

In  traditional  warfare,  sensor  and  weapon  functions  are  associated  with  specific 
platforms  or  systems.  NCW,  in  contrast,  seeks  transfer  the  intelligence  and  complexity  of 
military  systems  from  sensors  and  weapons  to  the  information  infrastructure  (Alberts, 
Garstka,  and  Stein,  1999).  Two  implications  of  this  scheme  are  that  sensors  and  weapons 
are  no  longer  paired  in  stovepiped  fashion  and  that  sensors  and  weapons  are  no  longer 
tied  to  specific  platforms.  The  decoupling  and  networking  of  sensors  and  weapons  not 
only  increases  their  potential  range  and  flexibility,  but  also  decreases  their  unit  cost  and 
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battlefield  footprint.  The  biggest  potential  impact,  however,  is  in  the  command  and  con¬ 
trol  (C2)  arena.  For  instance,  NCW  has  the  potential  to  forge  the  traditional  separation  of 
planning  and  execution  phases  into  a  single,  seamless  dynamic  planning  process.  Further, 
spreading  intelligence  and  combat  assets  throughout  the  network  dramatically  increases 
the  number  of  potential  decision-makers  and  the  speed  and  accuracy  of  their  decisions. 

2.  Future  Combat  Systems  (FCS) 

The  FCS  program  provides  the  innovative  technologies  required  to  transform 
land-based  warfare  according  to  NCW  concepts.  Developed  by  the  Army  and  the 
Defense  Advanced  Research  Project  Agency  (DARPA),  this  program  comprises  a  family 
of  manned  and  unmanned  air-  and  ground-based  maneuver,  maneuver  support,  and  sus¬ 
tainment  systems  to  equip  the  Unit  of  Action  (UA),  the  Army’s  primary  tactical  unit  for 
future  combat.  FCS  technologies  supply  the  UA  the  combat  power,  sustainability,  agility, 
and  versatility  required  for  full  spectrum  operations.  FCS  entities  will  be  networked 
through  an  architecture  of  command,  control,  communications,  computers,  intelligences, 
surveillance,  and  reconnaissance  (C4ISR)  assets  to  provide  networked  communications, 
operations,  sensors,  and  battle  command  systems.  The  C4ISR  systems  are  designed  to 
provide  unprecedented  levels  of  situational  understanding  and  synchronization  of  action. 

Perhaps  the  most  salient  feature  of  the  FCS  program  is  its  revolutionary  nature.  In 
particular,  FCS  employs  numerous  “leap-ahead”  technologies  that  mix  intelligence  and 
three-dimensional  (3-D)  perspectives  from  ground-level  detail  to  over-the-hill  panoramas 
for  overmatching  tactical  and  operational  advantage.  Not  since  the  development  of  night- 
vision  devices  has  the  U.S.  military  had  the  opportunity  to  overwhelm  the  enemy  by 
sensing,  analyzing,  planning,  and  then  acting  before  counterdetection.  These  capabilities 
ensure  that  U.S.  forces  will  continue  to  overmatch  their  opponents  in  technology  and 
information. 

3.  The  Soldier-Machine  Interface  (SMI) 

In  simplest  terms,  a  network  is  a  system  of  nodes  and  links.  Nodes  represent  sys¬ 
tem  components,  human  or  machine,  and  links  are  the  relationships  and/or  information 
flows  between  pairs  of  nodes.  As  a  human-machine  system,  the  links  between  The  FCS’s 
human  and  nonhuman  elements  are  crucial  to  the  effectiveness  of  the  entire  system.  The 
SMI  provides  the  technological  means  for  ensuring  the  dynamic  exchange  of  information 
between  the  human  and  nonhuman  elements  of  FCS.  To  realize  the  full  potential  of  FCS, 
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the  SMI  must  provide  an  effective  exchange  of  information  between  the  PCS  technolo¬ 
gies  and  the  human  operators  of  those  technologies. 

B.  PROBLEM 

In  accord  with  NCW  concepts,  the  intent  of  the  PCS  SMI  is  to  provide  a  shared 
understanding  of  tactical  situation  from  individual  soldier-operators  (actors)  to  UA  com¬ 
manders  (decision-makers)  and  in-between,  mid-echelon  leaders  who  perform  as  both 
actors  and  decision-makers.  To  address  the  full-spectrum  of  warfare,  the  PCS  incorpo¬ 
rates  several  different  functional  platforms  including  maneuver  [e.g..  Non  Line  of  Sight 
(NLOS)  cannon],  maneuver  support  [e.g..  Intelligent  Munitions  System  (IMS)],  and  sus¬ 
tainment  [e.g.,  Pamily  of  Medium  Tactical  Vehicles  (PMTV)]. 

Traditional  interfaces  emphasize  visual  displays  and  manual  controls  that  are  tai¬ 
lored  to  higher  echelon  decision-makers  performing  C2  functions.  This  sort  of  interface  is 
not  appropriate  to  lower  echelons,  particularly  to  the  dismounted  warfighter  who  presents 
several  special  display  and  control  problems.  A  model  (based  on  cognitive  psychology 
and  human  factors)  that  describes  the  relationship  between  echelon  and  interface 
requirements  is  needed. 

C.  REQUIREMENT 

The  PCS  program  requires  guidance  to  ensure  that  the  same  level  of  technical 
sophistication  used  to  develop  PCS  system  technologies  also  applies  to  the  SMI’s  design 
and  development.  Specifically,  PCS  SMI  design  and  development  must  be  a  soldier-cen¬ 
tered  process  that 

•  Accommodates  a  system-of-systems  approach  to  warfighting 

•  Includes  all  echelons  of  warfighters  (mounted  and  dismounted) 

•  Is  effective  across  the  full  spectrum  of  warfare. 

D.  APPROACH 

The  overall  objectives  of  the  PCS  SMI  task  are 

•  To  identify  and  assess  the  important  SMI  issues  within  the  human  dimen¬ 
sion  of  PCS  that  impact  on  system  viability  and  design 

•  Por  selected  critical  issues,  to  develop  experiments  and  conduct  analyses 
to  identify  potential  solutions  that  will  lead  to  enhanced  soldier  perform¬ 
ance. 
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This  document  addresses  the  first  objective  (identify  SMI  issues),  which  provides  the 
foundation  for  future  R&D  programs. 

Section  II  provides  a  review  of  the  literature  related  to  the  design  of  C4ISR  inter¬ 
faces.  Section  III  presents  a  model  for  designing  PCS  interfaces  and  some  preliminary 
guidelines  derived  from  the  model. 
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II.  REVIEW  OE  THE  LITERATURE 


Our  review  of  the  literature  spanned  three  different,  yet  somewhat  overlapping, 
content  domains:  general  philosophy  toward  the  design  of  interactive  technologies,  pub¬ 
lished  design  guidance  from  military  and  academic  sources,  and  instances  of  C4ISR 
interfaces  that  directly  relate  to  the  PCS. 

A.  DESIGN  PHILOSOPHY 

1.  Phases  of  Development 

The  development  of  systems  involving  humans  and  machines  includes  a  broad 
number  of  approaches  and  methods  — some  claiming  to  be  the  “definitive”  method, 
thereby  supplanting  previous  methods,  and  others  marking  a  stage  in  the  evolution  of 
human-machine  interaction.  Some  of  the  most  relevant  approaches  by  Tullis  and  others 
are  reviewed  in  Section  II.B.S.b.  Rather  than  commit  to  a  specific  approach,  this  section 
summarizes  the  most  salient  and  general  aspects  of  the  many  approaches  pertinent  to  the 
scientific  method,  the  engineering  process,  and  the  artistic  process  as  they  apply  to  the 
development  of  interactive,  multimodal  environments  in  PCS.  “Interactive”  refers  to 
human  activities  that  are  coordinated,  harmonized,  enhanced,  and  immersed— for  better 
or  worse— with  electromechanical  machines.  “Multimodal”  denotes  several  forms  of 
external  representations,  including  text,  graphics,  sounds,  numerals,  tables,  nonverbal 
gestures,  utterances,  motions,  events,  and  so  forth,  that  are  picked  up  by  the  corre¬ 
sponding  human  senses  and  maintained  in  different  forms  of  human  memory  (coded  as 
internal  representations— verbal,  visual,  acoustic,  haptic,  and  so  forth). 

A  significant  portion  of  the  literature  and  the  development  efforts  emphasizes  dis¬ 
play,  not  control.  Prom  an  academic  perspective,  sources  that  are  not  considered  as 
“core”  literature  are  available.  These  sources  include  gaming  and  entertainment,  aca¬ 
demic  and  corporate  research  conducted  at  smaller  institutions  or  overseas,  ecological 
perspectives,  the  graphic  arts,  and  design  principles  from  other  industries,  such  as  auto¬ 
motive.  To  be  fair,  when  faced  with  this  vast  amount  literature— encompassing  several 
disciplines  — designers  have  little  choice  but  to  grasp  the  closest  and  most  familiar 
sources,  or  they  could  become  overwhelmed.  Constrained  by  the  demands  of  time,  the 


first  priority  will  usually  be  the  composition  of  the  display.  Secondary  to  the  composition 
of  the  display  is  how  users  can  interact  with  the  display  via  the  keyboard,  mouse,  button, 
or  other  input  devices.  The  secondary  literature  is  available  and  captures  many  essentials 
of  the  mixed-mode  character  of  input  and  output;  however,  the  larger  picture,  as  origi¬ 
nally  sketched  by  Card,  Moran,  and  Newell  (1983),  for  instance,  remains  to  be  unified. 
The  PCS  program  should  seek  to  draw  upon  these  various  techniques  and  not  worry 
about  unification. 

For  FCS,  design  principles  transpire  at  four  levels.  From  the  general  to  the  spe¬ 
cific,  the  four  levels  of  analysis  are 

1.  The  scientific  method,  engineering  processes,  and  artistic  design  processes 

2.  Known  human  capabilities  or  principles  in  the  areas  of  cognitive  science, 
human  factors,  and  ergonomics 

3.  Principles  that  have  emerged  within  a  certain  domain  (e.g.,  aircraft,  auto¬ 
motive,  appliances,  computers) 

4.  A  specific  problem,  such  as  FCS. 

In  general,  the  principles  are  goal-oriented  and  result  in  a  product  for  a  particular  group 
of  peers,  consumers,  customers,  or  users.  In  fact,  in  addition  to  being  a  development 
effort,  FCS  also  serves  as  a  source  of  knowledge  for  other  elements  inside  and  outside  of 
the  Department  of  Defense  (DoD). 

In  this  hierarchy,  it  is  assumed  that  a  higher  level  generally  subsumes  and  con¬ 
strains  a  lower  level  (see  Table  ITl).  For  this  phase  of  the  FCS  effort,  the  remainder  of 
this  section  will  focus  at  Level  1  and  will  describe  three  complementary  processes 
relating  to  science,  engineering,  and  the  arts,  their  salient  characteristics,  and  what  the 
three  have  in  common.  More  specific  details  at  the  lower  levels  are  addressed  in  Sec¬ 
tions  II.B  and  II.C.  As  the  project  team  gains  more  knowledge  about  FCS  requirements  in 
2003,  a  successive  iteration  of  this  section  will  “drill  down”  to  specific  topics  that  will 
have  to  be  addressed  under  the  purview  of  these  three  disciplines. 

Scientific  research  can  be  considered  a  systematic  investigation  (i.e.,  the  gathering 
and  analysis  of  information)  designed  to  develop  or  contribute  to  generalizable  knowl¬ 
edge.  Engineering  follows  a  similar  premise,  but  the  “generalizable  knowledge”  is  an 
improved  efficiency  realized  in  an  artifact  (tool,  machine,  environment)  or  process  (a 
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Table  11-1.  Four  Levels  of  Analysis 


Level 

Participants 

Characteristics 

1.  Science,  Engineering, 
Design 

Philosopher  of 
science 

Policy/doctrine 

official 

Management 

Philosopher  at- 
large 

Sequenced,  interdependent  phases  of  activity; 

•  Requirements 

•  Design/ideation 

•  Implementation/production 

•  Evaluation/test/usability 

•  Release/publication/maintenance/marketing 

2.  Cognitive  Science, 
Human  Factors, 
Ergonomics, 

Marketing,  Product 
Development 

Researcher 

Scientist 

Engineer 

Artist 

Human  memory  and  cognition  (with  known 
limitations); 

•  Sensation 

•  Perception 

•  Short-term/working  memory 

•  Long-term  memory;  procedural,  declarative, 
episodic,  implicit,  linguistic 

•  Cognition;  problem  solving,  visual  reasoning, 
decision-making,  deduction,  induction, 
abduction,  ... 

•  Proprioception 

•  Language  and  communication 

•  Emotion,  affect,  personality 

•  Stressor  or  Insult;  fatigue,  hunger,  fear, 
nuclear,  biological,  and  chemical  (NBC)  agent, 

•  Enhancer;  caffeine,  amphetamine,  sleep,  food, 

•  Behavior,  action,  performance,  grasping, 
walking,  ... 

3.  Domain-Specific 
Constraints 

Researcher 

Scientist 

Engineer 

Artist 

External  elements  map  to  internal  elements  from 

Level  2 

•  Images;  shade,  color,  placement,  hue,  motion, 

•  Sounds;  tone,  pitch,  location,  duration, 
amplitude,  ... 

•  Proprioception;  first-person  sensation, 
orientation,  perception,  cognition 

•  Tactile/haptic;  action,  sensation,  perception, 
cognition 

•  Smell;  familiar  and  unfamiliar  smells,  odors 

•  Taste 
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Table  11-1.  Four  Levels  of  Analysis  (Continued) 


Level 

Participants 

Characteristics 

4.  Program, 
Project, 
Product 

Researcher 

Scientist 

Engineer 

Artist 

Subject  matter  expert 
(SME) 

User 

Consumer 

Aspects  of  Levels  1-3  constrained  by: 

•  Requirements  (particularly  user-driven 
requirements) 

•  Human  expertise,  capabilities,  limitations 

•  Environmental  constraints 

•  Market  forces,  market  demand 

•  Program/project  leadership,  goals 

FCS  -  an 
Instance  of 
Level  4 

Developers: 

Military  program 
leadership 

Government  scientist 

Federally  Funded 

Research  and 

Development  Center 
(FFRDC)  scientist 

University  scientist 

Corporate  scientist  and 
engineer 

Users: 

Commander 

SME 

Warfighter 

Many  aspects  of  Levels  1-3,  with  emphasis  on: 

•  Terrain 

•  Navigation 

•  Shared  communication  and  understanding 

•  User-centered  requirements,  knowledge 
acquisition,  task  analysis,  design, 
test/evaluation 

•  Use-cases 

•  Iterative  prototyping 

•  Rapid  Information  delivery 

•  Input/output  (I/O)  device  control  loop 

Note  for  Table  II-1 :  Lower  levels  Inherit  some  or  all  characteristics  from  higher  levels. 


way  of  doing  things).  Simply  put,  the  scientific  method  seeks  to  answer  questions, 
explain  phenomena,  or  solve  problems,  whereas  the  purpose  of  engineering  is  to  build 
better  tools  or  processes.  The  scientific  method  follows  five  interdependent  phases: 

51.  Formulate  hypothesis/identify  problem.  Propose  a  hypothesis  or  identify  a 
phenomenon  that  seeks  to  explain  a  phenomenon  or  solution  to  a  problem. 

52.  Design  the  method.  Construct  a  method  wherein  the  main  purpose  is  to 
generate  or  gather  evidence  that  provides  support  for  the  hypothesis  or 
proposed  solution. 

53.  Execute  method/gather  evidence.  Conduct  the  experiment  or  study 
according  to  the  procedure  described  in  the  method.  Gather  the  evidence 
produced  by  the  method. 
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54.  Evaluate  evidence.  Compare  the  observed  evidence  resulting  from  the 
method  with  the  expected  evidence  proposed  in  the  hypothesis.  If  the 
evidence  supports  the  hypothesis  or  solves  the  problem,  the  method  can  be 
considered  successful  (go  to  S5).  If  enough  evidence  from  various  sources 
and  investigations  has  been  gathered,  a  theory  might  be  the  result.  If  the 
evidence,  however,  is  not  conclusive,  the  hypothesis  or  proposed  solution 
must  be  amended,  giving  rise  to  a  new  method  (go  to  SI). 

55.  Disseminate  knowledge:  If  the  evidence  is  conclusive,  publish  the  results  in 
the  appropriate  medium,  such  as  a  peer-reviewed  journal,  conference 
proceedings,  and  so  forth. 

The  goal  of  engineering  is  to  make  an  artifact  or  process  more  efficient  product. 
Regardless  of  what  specific  approaches  may  suggest,  the  general  framework  is  structured 
according  to  the  following  interdependent  phases: 

El.  Define  problem/gather  requirements:  Identify  the  problem  (e.g.,  an 
inefficient  or  nonexistent  artifact  or  process).  Determine  the  human  or  user’s 
needs  with  respect  to  an  acceptable  solution. 

E2.  Design  the  product:  Construct  a  blueprint  or  plan  for  how  the  solution,  or 
product,  will  be  realized  as  a  new  or  improved  artifact  or  process 

E3.  Implement  the  product.  Build  the  proposed  solution. 

E4.  Test  and  evaluate  the  product.  Determine  whether  the  product  or  process 
meets  the  user’s  needs  or  requirements.  If  no,  go  to  El,  else  E5. 

E5.  Release  and  maintain  the  product:  Market,  sell,  distribute,  and  maintain 
the  product  or  process. 

Note  that  phases  S1-S5  and  E1-E5  correlate  strongly  and  differ  only  in  their 
goals  and  products  or  end  results. 

Although  contentious,  processes  within  some  of  the  arts  can  be  considered  consis¬ 
tent  with  science  and  engineering.  The  contention  rests  in  the  process  of  creation,  or  the 
“art,”  which,  historically,  has  been  set  apart  from  engineering  and  science  as  some  myste¬ 
rious  event  or  ability  stemming  from  creative  genius.  However,  some  of  the  perceived 
differences  might  be  considered  social  constructs,  not  epistemic  or  ontological  truths. 
Sadly,  little  has  been  written  about  bridging  these  three  disciplines  (B.  Schneiderman, 
personal  communication,  2002;  D.A.  Norman,  personal  communication,  2002),  although 
new  curricula  have  been  established  at  Carnegie  Mellon  University  (CMU),  Stanford,  and 
the  University  of  Southern  California  (USC)  to  meet  the  growing  demand  of  Web-based 
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design,  gaming,  and  entertainment.  The  following  portrayal  of  the  artistic  process  focuses 
on  the  similarities  rather  than  differences  among  science,  engineering,  and  the  artsd 

Al.  Gather  requirements/analysis.  Gain  a  thorough  understanding  of  the  cus¬ 
tomer,  user,  game  player,  listener,  and  so  forth  and  understand  the  require¬ 
ments— a  comprehensive  “customer  profile.”  Isolate  core  themes  and/or 
functional  requirements.  Allow  customer  to  review  and  then  commit  (by 
signing  off)  before  proceeding  to  the  next  step. 

A2.  Gain  feedback  from  customer.  Constrained  by  the  profile,  requirements, 
and  themes  from  Al,  translate  this  knowledge  into  a  basic  “ideation,”  not 
unlike  a  sketch,  rough  layout,  musical  phrase,  architectural  mock-up,  clay 
model  of  vehicle,  and  so  forth.  The  customer  must  again  commit  and  sign 
off.  Refine  as  necessary  or  even  refine  elements  of  A 1  if  necessary.  Customer 
must  sign  off. 

A3.  Design  the  product:  Broaden  the  ideation  into  a  design  for  the  final  product. 
In  architecture— a  blueprint,  in  graphic  arts  — a  detailed  layout,  and  so  forth. 
Present  the  design  to  the  customer,  refine  the  design,  go  back  to  A2  or  even 
to  A 1,  as  necessary.  If  the  customer  is  capricious,  remind  him/her  that  he/she 
has  approved  (signed-off)  various  phases. 

A4.  Implement  the  product:  Manufacture  the  final  product.  Depending  on  the 
medium,  if  immutable  (e.g.,  building,  logo,  vehicle,  annual  report),  go  to  A5. 
If  malleable  (e.g.,  software,  website,  interface,  video  game),  gain  more 
feedback,  as  required,  and  refine,  as  needed.  In  the  case  of  a  malleable 
product  and  capricious  customer,  remind  customer  that  preceding  phases 
have  been  signed  off. 

A5.  Release  and  maintain  the  product:  Market,  sell,  distribute,  or  maintain  the 
product. 

Note  the  requirement  for  the  customer  to  sign  off  and  commit  during  or  after  each 
phase  of  the  process.  Based  on  extensive  experience  (Hooton,  2002,  personal  communi¬ 
cation),  graphic  artists,  in  particular,  are  familiar  with  customers  who  fail  to  pin  down 
their  needs  or  adequately  describe  their  wants.  If  the  customer  cannot  adequately  articu¬ 
late  these  parameters,  the  likelihood  is  strong  that  additional  knowledge  will  continue  to 
surface,  which  then  affects— interrupts,  interferes  with— the  design  process.  For  example, 
the  successful  development  of  the  simple  Nike  “swoosh”  logo— implying  speed,  direc¬ 
tion,  agility,  motion— required  near-intimate  knowledge  of  the  organization  and  its  needs. 


^  This  process  was  first  defined  by  Hooton  from  Pictogram  Studios  (Garrett  Park,  Maryland),  J.  Toth 
(IDA),  and  A.  Graesser  (University  of  Memphis)  and  will  be  published  in  a  separate  IDA  report. 
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In  examining  the  similarities  among  science,  engineering,  and  art,  first  note  that 
these  activities  are  goal-directed— they  produce  products  for  a  particular  end  user  or 
customer.  Even  though  one  might  balk  at  the  notion  of  the  painter  or  composer  as  goal- 
directed  individuals,  their  activities  produce  a  result  in  a  given  medium.  In  gaming, 
entertainment,  and  graphic  arts  (the  artistic  activities  most  relevant  to  ECS),  this  is  par¬ 
ticularly  true.  Second,  these  activities  are  motivated  by  requirements.  Science  requires 
solutions  and  answers,  engineering  requires  better  artifacts  and  processes,  and  the  arts 
require  effective  media  that  communicate  a  particular  message,  emotion,  theme,  or  idea. 
In  the  setting  of  shared  understanding  for  ECS,  the  arts,  coordinated  with  science  and 
engineering,  should  permit  rapid,  efficient  conveyance  and  acknowledgement  of  various 
forms  of  information  among  warfighters  and  their  leaders.  Einally,  all  three  activities  are 
inherently  creative,  requiring  little  discussion  concerning  any  argument  against  the  crea¬ 
tive  nature  of  science  or  engineering.  Eor  each  discipline,  an  important  issue  regarding 
creativity  is  when  it  occurs  or  when  it  should  occur  to  produce  the  best  results.  In  science 
and  engineering,  creativity  is  required  in  noticing  a  phenomenon  or  identifying  a  problem 
and  in  constructing  the  appropriate  method,  solution,  artifact,  or  process  compelling 
enough  to  convince  scientific  peers  or  users.  In  the  artistic  process  described  previously, 
the  creative  aspect  is  constrained  to  phases  A2  and  A3.  The  remainder  of  the  phases 
involves  requirements  gathering  and  producing  the  final  product. 

2.  Rigid  Sequenced  Development  vs.  Iterative  Design 

Eollowing  the  general  descriptions  of  science  and  engineering  discussed  previ¬ 
ously,  research  and  product  development  efforts  place  relative  emphasis  on  certain  phases 
or  all  the  phases,  depending  on  the  problem  and  requirements.  As  such,  one  might  envi¬ 
sion  a  continuum  flanked  on  one  end  by  a  strict,  serial  approach  to  phases  S1-S5,  E1-E5, 
or  A1-A5,  and  a  concurrent  or  iterative  approach  on  the  other  end.  The  serial  approach, 
usually  referred  to  as  “Design  Erom  Specification”  in  Engineering  and  “Eirst  Principles” 
in  Science,  is  a  more  rigid  means  by  which  scientists  and  engineers  do  not  begin  the  next 
phase  until  the  current  phase  is  complete.  The  choice  of  approach  on  the  continuum  is 
constrained  by  user  requirements,  the  medium,  and  with  what  is  known  to  be  the  state  of 
the  art  (Eigure  ITl). 
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Figure  11-1.  Factors  Affecting  the  Discipiines  of  Science,  Engineering,  and  Art 

For  instance,  in  the  graphic  arts,  when  the  final  product  is  a  logo,  pamphlet,  or 
annual  report,  a  significant  amount  of  time  might  be  spent  in  the  earlier  phases— in  an 
attempt  to  “get  it  right”— before  the  final  product  is  generated  and  propagated  on  various 
forms  of  indelible  immutable  media  (paper,  soda  cans,  billboards,  and  so  forth.).  The 
designer  does  not  have  the  luxury  of  retracting  a  corporate  logo  or  annual  report  simply 
because  a  new  requirement  demands  a  rework  of  the  product.  In  essence,  the  customer  or 
end  user  is  “stuck”  with  the  product.  However,  if  the  designer  is  good  at  his  or  her  trade, 
the  product  will  also  be  good.  Likewise,  in  science,  particularly  if  resources  are  highly 
constrained  (Hubble  telescope,  linear  accelerator,  super  computer),  a  well-developed 
research  plan  including  the  problem  and  the  method  is  usually  required  before  resources 
are  allocated  for  a  particular  experiment  or  procedure.  In  engineering  or  architecture  of 
“hard”  products  such  as  buildings  and  vehicles,  once  the  skyscraper  is  built  or  vehicle  is 
rolling  off  the  assembly  line,  redesigning  the  product  is  not  an  option.  This  is  precisely 
the  reason  why  automobile  manufacturers  first  develop  models  in  clay  (phases  A2,  A3) 
before  plants  are  retooled  to  manufacture  the  final  product. 
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On  the  other  end  of  the  continuum,  the  phases  may  proceed  in  an  iterative  or  con¬ 
current  fashion.  Particularly,  in  ^o/tware  development  (note  the  emphasis  on  “soft”), 
where  the  medium  is  less  rigid  and  far  more  malleable,  several  iterative  prototypes  may 
evolve  before  the  final  product  is  released.  In  other  words,  engineering  phases  E1-E4  and 
artistic  phases  A1-A3  may  iterate  through  several  cycles  until  a  final  design  is  realized. 
And,  even  after  release,  successive  releases  or  versions  are  easy  to  assimilate  into  a 
common  platform  (Windows,  Play  Station  2,  and  so  forth). 

Eor  this  PCS  interface  task,  the  iterative  approach  will  be  possible  since  many  of 
the  display  and  input  elements  will  be  software  or  smaller  hardware  prototypes.  It  is  rec¬ 
ommended  that  development  proceed  through  the  careful  gathering  of  requirements  (and 
subsequent  evaluation  by  DoD  leadership)  from  SMEs  and  the  warfighter  familiar  with 
domains  most  applicable  to  PCS.  DoD  can  no  longer  afford  to  gather  requirements  from 
the  outmoded  BOPSAT  (bunch  of  people  sitting  around  a  table)  technique  because  this 
technique  has  given  birth  to  multi-million  dollar  debacles  that  could  have  been  avoided 
had  the  designers  asked  the  most  important  group  people— the  users— what  they  need. 

Norman  (in  particular  Norman  and  Draper,  1986;  Norman,  1993;  now  joined  by 
Nielsen,  1995)  persistently  argues  for  user-based,  user-centered  designs.  The  relatively 
few  staff  hours  and  telephone  calls  required  to  summon  the  appropriate  users  during  early 
phases  of  development  pay  handsome  dividends  years  down  the  road  when  the  product  is 
finally  operational. 

3.  Getting  to  Know  the  User:  Designing  for  Usability,  Utility,  and  Pleasure 

A  recent  volume  by  Jordan  (2000),  Designing  pleasurable  products:  An  introduc¬ 
tion  to  the  new  human  factors ,  is  so  unique,  practical,  and  comprehensive  in  its  approach 
that  some  discussion  is  required.  The  concept  of  “pleasure”  — setting  the  war  fighter’s 
domain— is  so  antithetical  to  the  rigid,  serious,  principled,  structured  approaches  present 
in  the  mainstream  defense  human-factors  literature  that  some  may  bristle  at  the  very 
thought. 

To  begin,  Jordan  identifies  three  phases  in  the  recent  history  of  human  factors: 

•  Phase  1:  20-30  years  ago.  The  user,  with  the  exception  of  defense,  was 
simply  ignored  in  the  engineering  or  manufacturing  process.  A  product  need 
was  identified  by  the  corporate  hierarchy  and  executed  by  corporate  scientists 
and  engineers. 
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•  Phase  2:  10-20  years  ago.  Human-factors  engineers  became  integrated  into 
the  development  process  but  were  only  engaged  in  a  “bolt-on”  sense.  In  other 
words,  the  core  product  was  developed,  and,  if  time,  resources,  and 
constraints  permitted,  human-factors  issues  were  “bolted  on”  to  the  product. 

•  Phase  3:  10  years  ago  to  the  present.  Integrated  human  factors  have  begun 
to  appear.  In  other  words,  the  needs  of  the  user  are  considered  from  the  very 
start  of  the  product  development  process. 

A  simple  thought  experiment  illustrates  this  shift  in  perspective,  comparing  (1) 
the  bulky  metal  computing  keyboards  from  the  1970s  with  the  slender  plastic  keypads  of 
today  or  (2)  the  evolution  of  the  workstation  mouse,  to  trackball  (which  had  problems),  to 
touch  pad,  and  onward  to  the  mouse,  again.  The  functions  text  entry  (keyboard)  and  win¬ 
dows  manipulation  (mouse)  remained  somewhat  invariant  through  this  evolution.  What 
changed  were  the  forms  of  interaction  with  the  devices  and  the  emphasis  on  the  manner 
in  which  the  user  felt  satisfied  with  the  interaction. 

Although  usability  has  emerged  as  an  important  principle  (Nielsen,  1995),  Jordan 
(2000)  argues  usability  alone  is  not  sufficient  when  attempting  to  meet  all  the  user’s 
needs.  Beginning  with  Maslow’s  (1970)  hierarchy  of  needs  [from  bottom  to  top: 
(1)  physiological,  (2)  safety,  (3)  belongingness/love,  (4)  esteem,  and  (5)  self-actualiza¬ 
tion],  the  more  complete  approach  to  design  is  based  on  the  user’s  needs  (not  to  be  con¬ 
fused  with  the  engineering  concept  of  “requirements”),  and  how  they  are  satisfied  within 
and  among  these  five  levels.  Once  a  lower  level  has  been  satisfied  (e.g.,  hunger),  humans, 
according  to  Maslow,  will  always  pursue  higher  needs.  However,  humans  continually 
move  up  and  down  these  levels  on  a  daily,  if  not  hourly,  if  not  moment-by-moment  basis. 

Jordan  (2000)  maps  the  Maslow  hierarchy  to  three  levels  of  product  needs: 

1.  Functionality.  The  product  must  function  so  that  at  a  minimum,  the  user  can 
perform  and  complete  a  task. 

2.  Usability.  The  product  must  not  only  function,  but  it  must  be  easy  to  use. 
That  is,  interaction  with  the  artifact  should  not  be  cumbersome,  thus 
impeding  the  user’s  task. 

3.  Pleasurable.  The  product  is  not  only  usable,  but  it  is  also  a  pleasure  to  use. 
In  other  words,  form,  function,  usability,  and  aesthetics  become  one.  The 
user  reaches  a  state  that  Jordan  refers  to  as  “pleasure.”  Similar  concepts  have 
been  discussed  as  “experiential  thought”  (Norman,  1993),  “flow”  or  “optimal 
flow”  (Csikszentmihalyi,  1990),  or  even  the  experience  of  “being  in  the 
zone”  as  described  by  amateur  or  professional  athletes.  This  mental  state  is 
consistent  with  the  more  principled  concepts  of  automaticity,  implicit 
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memory,  and  procedural  knowledge.  From  a  formal  standpoint,  aspects  of 
this  state  include  an  effortless,  unconscious,  enjoyable  experience,  ostensibly 
allowing  the  user  to  attain  the  higher  levels  of  Maslow’s  hierarchy. 

From  the  perspective  of  the  DoD  human-factors  specialists  and  their  customer,  the 
soldier,  very  little  might  be  considered  pleasurable  when  it  comes  to  an  experience  as 
harsh  and  potentially  terminal  as  combat.  With  the  exception  of  experiencing  or  incurring 
injury,  however,  the  following  question  is  posed: 

Given  the  harsh  and  unpleasant  context  of  combat,  the  tedium  of  training, 

and  the  myriad  related  activities,  why  shouldn’t  products  for  the  soldier  be 

as  usable  and  pleasurable  as  possible? 

This  question  first  compels  us  to  distinguish  between  the  pleasure  associated  with 
work,  daily  tasks,  and  other  activities  vs.  the  displeasure  of  combat  and  casualty.  With 
the  exception  of  terrorists,  despots,  and  anarchists,  few  will  argue  that  killing  is  pleasur¬ 
able.  Nevertheless,  the  aim  of  the  design  process  should  facilitate  the  DoD  precept  of 
readiness  to  the  greatest  extent  possible.  A  weapon  that  jams,  a  display  that  is  confusing, 
a  switch  or  button  that  is  difficult  to  locate,  a  command  or  piece  of  vital  information  that 
is  lost  in  the  fog  of  war  all  place  the  soldier  at  risk.  Thus,  the  concept  of  pleasure  herein 
is  examined  from  the  context  of  product  development  as  it  occurs  in  mainstream  industry 
but  takes  in  the  principles  described  previously  (item  3.  above),  referring  to  the  mental 
state  in  which  satisfied  users  find  themselves.  Users  who  are  satisfied  with  their  work  are 
facilitated  by  tools  that  support  their  work.  In  addition,  in  the  realm  of  product  develop¬ 
ment,  Jordan  (2000)  has  advanced  a  myriad  of  principles  directly  applicable  to  DoD’s 
purposes.  One  goal  for  future  work  should  be  to  bridge  the  gulf  between  industry  and 
DoD.  Industry  takes  great  strides  to  understand  the  market  and  user/consumers  by 
gaining  the  attention  and  loyalty  of  existing  and  potential  customers.  On  the  other  hand, 
DoD  has  sometimes  pursued  product  development  in  isolation,  seemingly  unaware  of  (or 
unwilling  to  heed)  the  methods  that  industry  routinely  employs.  Even  though  the  eco¬ 
nomic  forces  in  industry  are  different  from  those  in  DoD,  some  lessons  from  the  private 
sector  have  clear  relevance  to  the  defense  establishment. 

Keeping  these  distinctions  in  mind,  given  that  a  product  meets  the  requirements  of 
functionality,  usability,  and  aesthetics  and  provides  some  sort  of  user  benefit,  Jordan 
(2000)  identified  four  levels  of  pleasure— corresponding  to  Maslow’s  (1970)  hierarchy: 

1.  Physiological.  The  product  or  activity  meets  the  user’s  physical  needs.  When 
necessary,  all  aspects  of  the  soldier  ontology  (see  Section  III.B)  have  been 
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addressed  and  afford  the  most  efficient  and  direct  interface  that  optimizes 
behavior  and  performance  and  minimizes  negative  properties  such  as 
discomfort,  fatigue,  and  boredom. 

2.  Psychological.  The  product  or  activity  meets  the  user’s  psychological 
demands  (i.e.,  at  the  “cognitive”  level).  The  product  is  mentally  stimulating. 
Soldiers  at  all  echelons  can  think  about  the  strategic,  tactical,  and  operational 
modes  for  which  they  are  trained. 

3.  Sociological.  The  product  or  activity  facilitates  social  interaction  in  the 
broadest  sense.  This  includes  the  perception  of  authority  in  the  chain  of 
command;  a  menacing  appearance  that  intimidates  the  enemy— in  the  form 
of  clothing,  weaponry,  and  accessories  — and  other  labels,  icons;  and 
insignias  that  convey  mutual  respect,  self-sacrificing  trust,  and  a  willingness 
to  collaborate  within  the  team. 

4.  Ideological.  The  product  or  activity  facilitates  or  speaks  to  the  user’s  higher 
purposes.  Industry  depends  on  branding  and  product  ideology  to  grab  and 
maintain  a  loyal  customer  base.  The  DoD  ideology,  one  can  assert,  is  to 
preserve  and  defend  the  Constitution.  The  enemy,  on  the  other  hand,  should 
receive  the  ostensible  message  that  the  American  soldier  is  a  force  to  be 
reckoned  with  if  a  clear  picture  of  DoD  ideology  has  been  apprehended. 

Some  may  ask  the  following  question:  What  does  this  have  to  do  with  DoD? 
Now  that  engineers  and  scientists  are  at  least  acknowledging— and,  in  some  instances 
putting  into  practice  — the  transition  from  machine-centered  design  to  user-centered 
design,  the  answer  is  quite  a  bit.  A  good  portion  of  Jordan’s  volume  is  devoted  to  getting 
at  the  best  way  to  understand  the  user  and  then  developing  products,  artifacts,  and  pro¬ 
cesses  that  meet  the  various  needs  listed  previously,  based  on  a  deeper  understanding  of 
the  user.  Furthermore,  user  feedback  is  not  limited  to  the  ubiquitous  user  survey.  Appen¬ 
dix  A  describes  the  methods  for  understanding  users. 

The  following  list  summarizes  the  major  techniques  for  obtaining  user/participant 
feedback: 

•  Private  camera  conversation.  The  user  first  interacts  with  the  product  or 
prototype,  and  then,  seated  alone  in  front  of  a  video  recording  device, 
describes  his/her  impressions  of  the  product. 

•  Co-discovery.  Two  users  who  know  each  other  work  together  to  explore  the 
product  or  a  concept  and  articulate  their  ideas  and  impressions.  The  designer, 
scientist,  or  engineer  may  or  may  not  be  with  the  dyad. 

•  Focus  groups.  A  small  group  of  people  (5-12)  are  seated  together  and  led  by 
a  facilitator,  who  guides  the  group  in  discussing  a  product  or  concept.  The 
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facilitator  usually  follows  an  agenda,  prompts  the  group  when  stuck,  and 
mediates  the  discussion  so  that  all  the  group  members  have  an  opportunity  to 
speak. 

Think-aloud  protocols.  The  user,  seated  with  the  investigator,  articulates  his 
or  her  thoughts  while  using  the  product  and  following  a  reasonably  structured 
task  [e.g.,  programming  a  videocassette  recorder  (VCR),  driving  a  car,  and  so 
forth]. 

Experience  diaries.  Users  carry  diaries  with  them  for  a  few  to  several  weeks 
as  they  use  a  product.  The  entry  in  diary  can  be  a  combination  of  a  minia¬ 
turized  questionnaire,  a  list  of  brief  questions,  a  checklist,  and  so  forth. 

Reaction  checklists.  While  interacting  with  the  product,  the  user  checks  off 
a  list  of  positive  and  negative  experiences. 

Field  observations.  Users  are  observed  as  they  interact  with  the  product  in 
as  close  to  natural  a  setting  as  possible.  Whenever  possible,  the  influence  of 
the  investigator  is  kept  to  an  absolute  minimum. 

Questionnaires.  The  users  complete  a  questionnaire  after  using  the  product. 
In  fixed-response  questionnaires,  users  answer  questions  according  to  multi¬ 
point  interval  scales.  In  open-ended  response  questionnaires,  the  users  are 
allowed  to  provide  written  replies  to  questions. 

Interviews.  A  designer  or  facilitator  interviews  the  user  in  three  ways 
(structured,  semi-structured,  or  unstructured)  to  gain  insights  into  the  product 
or  concept.  This  method  is  similar  to  a  face-to-face  questionnaire. 

Immersion.  The  designer  becomes  the  user  and  records  his  or  her  own 
impressions  of  the  product  or  concept.  Immersion  (described  in  greater  detail 
in  Appendix  A)  is  the  prevailing  method  in  DoD  but  is  riddled  with  bias  and 
should  be  avoided. 

Laddering.  A  designer  or  facilitator  asks  the  user  about  a  positive  or 
negative  aspect  of  the  product  or  concept  (e.g.,  one  calorie  drink).  The  user 
answers  the  question  (e.g.,  I  want  to  be  thinner;  i.e.,  Maslow  Level  1),  and 
the  designer  asks  why.  The  user  replies  again  (e.g..  Because  if  Fm  thinner. 
I’ll  feel  better;  i.e.,  Maslow  Level  2),  and  the  designer  again  asks  “why.”  The 
user  again  replies  and  so  forth. 

The  purpose  of  laddering  is  to  gather  information  about  formal  and  experi¬ 
ential  properties  and  benefits  of  the  product,  detailed  information  about  the 
user  (e.g.,  Maslow  needs  or  general  requirements),  and  relationships  among 
these  three  criteria. 


Participative  creation.  A  group  of  users  and  the  designer  collaborate  on  the 
design  of  the  product.  This  method  is  similar  to  the  focus  group  but  is 
considered  more  hands-on. 

Controlled  observation.  This  method  is  also  known  as  the  controlled 
experiment.  It  identifies  independent/dependent  variables,  statistical  tests, 
and  so  forth  and  is  the  mainstay  of  principled  human-factors  research. 

Expert  appraisal.  A  small  group  of  SMEs  or  content  experts  who  are  not 
affiliated  with  the  design  process  (e.g.,  a  seasoned  video  game  players 
evaluating  a  new  game)  evaluate  the  product.  SMEs  may  even  be  human- 
factors  experts  and  function  in  a  Red  Team  capacity. 

Property  checklists.  The  designer  organizes  a  list  of  positive  and  negative 
properties  associated  with  the  product.  These  properties  can  be  derived  from 
the  product  requirements.  As  development  process  proceeds,  the  product  is 
evaluated  according  to  this  checklist. 

Kansei  engineering.  This  method  allows  the  designer  to  understand  the 
relationship  between  formal  and  experiential  properties  of  a  product  and 
gives  insight  into  benefits  that  the  users  want  to  gain  from  products  and  into 
the  properties  that  realize  these  benefits.  The  designer  either  manipulates 
various  individual  properties  or  features  of  the  product  and  statistically 
validates  the  users’  impressions  of  these  differences  via  cluster  analysis  or 
conducts  observations  in  situ  [unlike  field  observations,  however,  these 
observations  occur  while  users  interact  with  the  product  (e.g.,  determining 
the  requirements  for  refrigerators  by  visiting  users’  homes  and  observing 
their  interactions  with  the  refrigerator)]. 

Sensorial  Quality  Assessment  (SEQUAM).  Eike  Kansei  engineering,  this 
method  manipulates  various  properties  of  the  product  and  tries  to  understand 
how  properties  are  linked  with  product  benefits.  Correlational  statistics  are 
used  instead  of  cluster  analysis,  so  fewer  properties  can  be  examined. 

Product  Personality  Assignment  (PPA).  Humans  tend  to  anthropomorphize 
(i.e.,  assign  human  personality  traits)  to  many  objects  in  their  environment- 
even  animals.  This  method  analyses  users’  impressions  of  products  through 
individual  product  “personality”  traits.  Research  has  determined  that  people 
tend  to  assign  general  traits  to  products  (e.g.,  Volkswagen  Bug  is  “cute”)  and 
project  their  own  individual  traits  onto  products.  Eor  example,  an  introvert  on 
Myers-Briggs  scale  may  perceive  a  product  as  introverted. 

Mental  mapping.  This  method  is  similar  to  PPA,  but  traits  focus  on  famous 
public  figures  or  on  extemporaneous  stories  users  make  up  about  the  product. 
This  technique  is  highly  successful  in  industry,  but  the  methods  employed  by 
each  designer  are  typically  proprietary.  This  method  keys  in  on  unconscious. 


even  archetypal  (Jungian  or  Freudian)  concepts  that  create  a  strong  link 
between  the  user  and  the  product. 

•  Expert  case  studies.  In  this  method,  experts  evaluate  products— technical, 
functional,  aesthetic  — according  to  features  and  benefits  that  have  led  to  suc¬ 
cess  or  failure. 

•  Experiential  case  studies.  This  method  is  similar  to  expert  case  evaluation, 
but,  in  this  instance,  theusers  evaluate  the  product. 

B.  PUBLISHED  GUIDANCE 

1.  Background 

The  intent  of  this  literature  review  is  to  examine  and  identify  issues  relating  to 
interface  design  guidance  for  the  FCS  SMI.  This  review  contains  a  bibliography  (see 
Appendix  B  for  references)  and  identifies  the  types  of  human-factors  information  cur¬ 
rently  available.  This  is  an  evolving  review.  It  not  intended  to  provide  exhaustive  cover¬ 
age  but  to  cover  enough  of  the  research  to  make  decision-makers  aware  of  the  important 
issues  during  FCS  SMI  development  so  that  soldiers  can  eventually  be  presented  with  an 
integrated  and  seamless  system. 

2.  Methods 

A  search  of  the  literature  was  conducted  using  STILAS,  the  Institute  for  Defense 
Analyses  (IDA)  Library  Catalog.  Searches  were  also  conducted  using  Psycinfo  (through 
George  Mason  University)  and  the  World  Wide  Web  (WWW)  using  the  Google  and 
Yahoo!  search  engines.  Examples  of  search  elements  included  combinations  of  the  fol¬ 
lowing  key  words:  “Human-Factors  Evaluation,”  “Soldier-Machine  Interface  Design,” 
“Human-Computer  Interface  Guidelines,”  “Human-Eactors  Checklist,”  “Design  Philoso¬ 
phy,”  “Interface  Standards,”  “Interface  Interoperability,”  “Interface  Design,”  “Systematic 
Approach  to  Interface  Development,”  “Guidelines  for  Developing  an  Interface,”  “Custom 
User  Interface,”  and  related  variations.  More  than  300  books  and  articles  were  retrieved, 
and  approximately  200  were  reviewed  for  utility.  Both  paper  and  electronic  copies  of 
these  documents  are  stored  at  IDA.  A  database  was  constructed  in  MS  Excel  and 
MS  Word  to  catalog  these  items. 

The  database  of  reviewed  documents  contains  the  following  field  names:  Internal 
document  name  (for  electronic  copies),  Author(s),  Year,  Title,  Source,  Media  (Paper; 
Web),  Type  (Eiterature  Review;  Design  Guidelines),  Status,  Description,  Taxonomy 
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(DoD;  Other  Non-DoD;  Academic;  Industry).  The  physical  database  contains  paper  and 
electronic  versions  of  documents. 

3.  Results 

The  initial  literature  search  was  restricted  to  military  references.  The  results  of 
this  search  yielded  a  variety  of  precision  detailed  articles  and  Military  Standards  (MIL- 
STDs)  involving  interface  display  design  guidance.  These  highly  structured  and  detailed 
standards  include  guidance  on  the  display  and  use  of  colors,  auditory  signals,  image  blink 
rates,  menu  layout,  data  formatting,  input  devices,  displays  of  warning  messages,  the  use 
of  shortcuts,  and  time  intervals  between  actions.  The  following  two  examples  from  Avery 
and  Bowser  (1992)  illustrate  the  depth  of  detail  contained  in  some  guidelines: 

Minimum  height  of  displayed  characters  should  be  1/200  of  viewing 
distance.  For  example,  a  viewing  distance  of  36  inches  requires  a 
0.18-inch  character  height  on  the  display  screen.  Character  width  should 
be  50-100%  of  character  height.  Character  stroke  width  minimum  is 
10-12.5%  of  character  height.  Maximum  text  size  should  not  exceed  10% 
of  the  available  vertical  display  area  on  a  full-size  screen 
(10.3.5.3— Character  Height  and  Width). 

Do  not  indicate  window  movement  by  an  outline  only.  Provide  either  full 
movement  of  the  window  or  move  an  outline,  leaving  the  window  visible 
on  the  screen  (7.2.3. 1  —  Window  Movement  Feedback). 

The  specificity  of  these  guidelines  is  highly  structured  and  contains  detailed 
design  guidance,  but  design  principles  are  lacking.  In  fact,  one  could  argue  that  these  are 
not  guidelines;  rather,  they  more  closely  resemble  directions  or  instructions.  In  addition, 
the  details  in  this  example  may  or  may  not  generalize  from  one  domain  to  another.  True 
design  principles,  on  the  other  hand,  guide  the  designer  from  the  general  to  the  specific 
through  a  multiphased  process,  as  described  earlier. 

a.  Military  Documents  Relevant  to  FCS 

The  initial  review  yielded  the  following  military  documents,  which  were  deemed 
relevant  to  the  FCS  interface  effort: 

•  MIL-STD-1472F:  Department  of  Defense  Design  Criteria  Standard: 
Human  Engineering  (DoD,  1998).  This  standard  establishes  general  human 
engineering  criteria  for  designing  and  developing  military  systems, 
equipment,  and  facilities.  Its  purpose  is  to  present  human  engineering  design, 
criteria,  principles,  and  practices  to  be  applied  in  the  design  of  systems. 
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equipment,  and  facilities  so  as  to  achieve  required  performance  by  operator, 
control,  and  maintenance  personnel;  minimize  skill  and  personnel 
requirements  and  training  time;  achieve  required  reliability  of  personnel- 
equipment  combinations;  and  foster  design  standardization  within  and  among 
systems. 

•  MIL-STD-2525B:  Department  of  Defense  Interfaee  Standard:  Common 
Warfighting  Symbology  (DoD,  1999).  This  standard  is  designed  to  eliminate 
conflicts  within  various  symbol  sets  and  to  bring  a  core  set  of  common 
warfighting  symbology  under  one  DoD  standard.  It  provides  sets  of  command, 
control,  communications,  computer,  and  intelligence  (C4I)  symbols,  a  coding 
scheme  for  symbol  automation  and  information  transfer,  an  information 
hierarchy  and  taxonomy,  and  technical  details  to  support  systems. 

•  North  Atlantic  Treaty  Organization  (NATO)  Standardization  Agreement 
(STANAG)  2019:  Military  Symbols  for  Land  Based  Systems  (North 
Atlantic  Treaty  Organization,  1990).  This  standardization  is  aimed  to 
promote  interoperability  for  the  exchange  of  secondary  imagery  among 
NATO  C4I  systems  to  ensure  that  colors,  symbols,  line  size/quality,  and  fonts 
are  consistent  throughout  a  given  system.  The  major  features  include  the 
application  of  four  distinctive  frame  shapes  to  identify  unknown,  friendly, 
neutral,  and  hostile  forces  and  the  addition  of  tactical  task  graphics. 

•  MIL-STD-411F :  Department  of  Defense  Design  Criteria  Standard:  Airerew 
Alerting  Systems  (DoD,  1977).  This  standard  covers  aircraft  aircrew  station 
alerting  systems,  including  physical  characteristics  of  the  alerting  system’s 
visual,  auditory,  and  tactile  signals  to  establish  uniform  aircrew  station 
alerting  systems  to  maximize  recognizability. 

•  Lewis  and  Fallesen  (1989):  Human-Faetors  Guidelines  for  Command  and 
Control  Systems:  Battlefield  and  Deeision  Graphies  Guidelines.  This 
document  provides  graphics  guidelines  in  detail. 

b.  Academic  Literature 

In  an  effort  to  tease  out  firm  design  principles,  the  focus  of  the  literature  review 
was  broadened  to  include  academic  articles.  Whereas  the  military  literature  converged 
into  structured  rules  as  illustrated  previously,  the  academic  literature,  alternately, 
diverged  into  broad,  philosophical  discussions  on  design  approaches  (e.g..  Laurel,  1991). 
This  literature  often  approaches  interface  design  as  an  art  and  is  a  stark  contrast  to  the 
detailed,  somewhat  rigid  military  specifications,  which  follow  the  engineering  process 
and  scientific  method. 
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Several  key  articles  (Tullis,  1988;  Kelley,  1984)  stress  the  notion  of  iterative  pro¬ 
totypes  and  evaluations  with  significant  emphasis  on  the  end  user.  “Screen  design  is  a 
dynamic  process.  It  has  elements  of  art  and  requires  creativity  and  inventiveness”  (Tullis, 
1988).  He  described  six  steps  of  an  iterative  design  process,  as  illustrated  in  Table  IT2. 


Table  11-2.  Tullis’  Six-Step  Iterative  Design  Process 
(Source:  Tullis,  1988) 


Step 

Process 

One 

Requirements  and  constraint  analysis 

Two 

Task  analysis  and  scenario  development 

Three 

Development  of  design  rules 

Four 

Development  of  an  implementation  philosophy 

Five 

Early  design,  prototyping,  and  evaluation 

Six 

Full-scale  prototyping  and  implementation 

Kelley  (1984)  also  described  a  systematic,  empirical  methodology  for  developing 
a  computer  application  (a  personal  calendar).  Although  the  computer  application  itself  is 
somewhat  out  of  date,  the  six  evaluative  steps  again  illustrate  the  process  of  iteration. 
Table  11-3  illustrates  these  steps. 


Table  11-3.  Kelley’s  Six-Step  Evaluative  Process 
(Source:  Kelley,  1984) 


Step 

Process 

One 

Task  analysis 

Two 

Structure  development 

Three 

First  run  of  program  (simulation  mode/storyboard) 

Four 

First  approximation  (inputs  from  step  three  used  to  develop  first 
draft  of  product) 

Five 

Second  run  of  program/intervention  phase  (“iterative  design 
phase”):  as  this  step  progresses  and  bugs  augmented,  the 
experimenter  phases  out  of  loop  after  point  of  diminishing  return 

Six 

Cross-validation  with  new  participants:  no  experimenter 
intervention  and/or  assistance  in  product 

These  earlier  attempts  proposed  one  or  two  iterations  before  the  final  product  was 
realized.  Later,  an  iterative  spiral  approach  emerged,  in  which  many  iterations  are  possi¬ 
ble  before  the  final  product  is  realized. 
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Blackwood  et  al.  (1997),  in  their  guidance  for  helmet-mounted  displays  (HMDs), 
suggest  a  three-tier,  highly  integrated  research,  testing,  and  evaluation  strategy.  This 
approach  represents  a  shift  from  current  practice  because  it  includes  an  intermediate, 
semi-controlled  set  of  research  and  testing  experiments  between  laboratory  and  bench 
testing  and  operational  field  operations.  Equally  important,  it  incorporates  the  active 
involvement  of  users  in  every  stage  in  the  development  sequence.  The  three  tiers  are 
defined  in  Table  IT4. 


Table  11-4.  Three-Tier  Design  Process 
(Source:  Blackwood,  1997) 


Tier 

Process 

One 

Controlled  laboratory  or  bench  testing  of  system’s  technical 
performance  —both  with  and  without  human  users 

Two 

Controlled  field  experiments  with  a  variety  of  users,  from  experienced 
to  new  entry,  and  with  system  experts  from  design  teams  Involved 

Three 

Operational  test  and  evaluation  (OT&E)  exercises  employing  soldiers 
from  the  target  population  In  virtual-type  simulations  and  live 
simulations  In  a  realistic  operational  environment 

As  described  in  Table  IT4,  this  methodology  brings  the  end  user  into  the  testing 
and  evaluation  process  earlier  through  controlled  testing  that  combines  the  varied  envi¬ 
ronmental  and  personnel  conditions  from  operational  testing  with  the  structured  data 
collection  and  controlled  conditions  characteristic  of  laboratory  testing.  The  mid-level 
tier  of  trials  allows  for  the  interaction  of  the  potential  users  and  the  design  team  in  condi¬ 
tions  that  combine  structured  data  collection  with  variability  in  environmental  conditions 
(e.g.,  day,  dusk,  night  for  visual  factors;  camouflage  for  terrain  variations)  and  individual 
variation  in  users  (e.g.,  effects  of  regional  accents  on  the  performance  of  a  voice  recogni¬ 
tion  system  for  acoustics)  (Blackwood  et  al.,  1997). 

Blackwood  et  al.  (1997)  also  suggest  that  for  the  display  to  be  both  performance 
enhancing  and  cost  effective,  subsequent  operational  testing  should  be  implemented  at 
the  small-unit  level  (minimizing  larger  scale  testing  scenarios).  This  soldier  “in-the-loop” 
testing  should  also  have  an  increased  scope,  with  longer  durations  or  cycles  of  task  per¬ 
formance  than  those  that  have  been  used  in  the  past. 

In  the  early  stages  of  the  research,  development,  test,  and  evaluation  (RDT&E) 
process,  critical  design  decisions  are  often  made  by  scientists  and  engineers  who  are 
knowledgeable  about  the  technology  but  have  less  expertise  in  the  operational  employ¬ 
ment  of  the  new  system.  Without  consistent  and  thorough  collaboration  with 
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knowledgeable  user  representatives,  the  evolving  design  is  often  driven  by  the  engineer’s 
or  technician’s  view  of  what  is  important  or  what  is  possible— with  less  focus  on  what  is 
most  needed  by  the  soldier.  PCS  represents  a  major  step  forward  in  technology.  To  be 
effective,  the  research,  development  and  design  process  must  have  soldier  input, 
involvement,  and  commitment.  User-centered  design  is  a  significant  aspect  of  the  three¬ 
tiered  process  described  previously. 

Though  not  exhaustive,  the  following  references  are  considered  particularly  rele¬ 
vant  to  PCS.  They  are  listed  and  briefly  described,  as  follows: 

•  Kroemer,  Kroemer,  and  Kroemer-Elbert  (1994):  Ergonomics:  How  to 
Design  for  Ease  and  Efficiency.  Serving  as  a  reference  manual,  this  book 
organizes  standards,  physical  limitations,  controls,  and  displays  for  human- 
factors  engineering. 

•  Laurel  (1990):  The  Art  of  Human-Computer  Interface  Design.  This  book 
is  philosophical  in  nature.  Each  chapter  describes  a  different  author’s  view  on 
interface  design.  Some  author’s  discuss  color  use  and  sound  use  for  display 
cues. 

•  Norman  (1991):  The  Psyehology  of  Menu  Seleetion:  Designing  Cognitive 
Control  at  the  Human/Computer  Interfaee.  This  book  does  a  thorough  job 
adressing  interface  menu  design  issues.  Norman  writes,  “Menus  allow  for  a 
relatively  effortless  selection  of  paths  through  a  system.”  One  empirical 
finding  is  that  users  favor  distinctive  icon  menus  over  either  the  word  menus 
or  the  representational  menus. 

•  Shepard  (1991):  Report  of  Results  of  ATCCS  Contingency  Eorce 
Experiment-Light  (ACEE-L)  Group  B,  Soldier-Maehine  Interfaee  (SMI) 
Assessment.  This  article  provides  a  protocol  template  for  iteration  evaluation. 
Each  design  issue  is  examined  — followed  by  results  (from  structured 
interviews)  and  conclusions. 

•  Flach  and  Dominguez  (1995):  Use-Centered  Design:  Integrating  the  User, 
Instrument,  and  Goal.  This  article  stresses  that  interface  designers  should 
focus  attention  on  the  functional  relations  among  users,  instruments,  and 
goals. 

•  Norman  (1993):  Things  that  Make  Us  Smart:  Defending  Human 
Attributes  in  the  Age  of  the  Maehine.  This  book  adresses  the  gap  between 
the  designer’s  expectations  and  the  user’s  experience,  which  are  often  at 
odds.  It  points  out  weaknesses  in  machine-centric  approaches  to  design,  in 
which  the  end  user  is  largely  left  out  of  the  design  process. 
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•  Carroll  (1991):  Designing  Interaction:  Psychology  at  the  Human- 
Computer  Interface  and  Nardi  (1996):  Context  and  Consciousness: 
Activity  Theory  and  Human-Computer  Interaction.  Both  of  these  volumes 
address  the  disembodied  nature  of  mainstream  cognitive  science.  For 
instance,  a  GOMS^  analysis  might  serve  a  keystroke  model  well  but  be 
entirely  insensitive  to  the  fact  that  the  user  might  be  of  Western  or  Eastern 
descent.  Soviet  theories  of  activity  (e.g.,  Vygotsky,  1962),  which  promote  a 
unified  conception  of  the  user  and  an  environment,  help  motivate  much  of 
this  theory. 

An  important  note  is  that  most  of  the  articles  in  this  review  have  centered  on 
interface  display  rather  than  interface  control.  This  is  not  an  omission  but  is  caused  by  the 
large  and  broad  volume  of  articles  related  to  information  display.  Another  important  note 
is  the  publication  year  of  most  of  the  journals  referenced.  Most  of  the  articles  precede  the 
“Age  of  the  Internet,”  and,  as  such,  the  results  may  need  to  be  reexamined. 

c.  Display  Usability  Research 

Previous  research  of  pilot  use  with  heads-up  displays  (HUDs)  has  demonstrated 
utility  because  the  displays  do  provide  the  pilots  an  advantage  by  enabling  them  to  stay 
on  course  and  to  conduct  successful  instrument  landings.  However,  research  has  also 
shown  that  pilots  who  use  an  HUD  are  more  likely  to  miss  occasional,  low-probability 
events,  such  as  an  aircraft  moving  onto  the  runway  during  an  approach  for  landing 
(Wickens  and  Long,  1994). 

Alternately,  the  use  of  HMDs  by  the  dismounted  soldier  poses  its  own  particular 
set  of  constraints  that  are  quite  different  from  those  encountered  in  the  cockpit.  Because 
the  soldier  is  mobile,  the  issue  of  providing  a  stable  base  for  the  display  becomes  even 
more  important  than  it  is  in  the  cockpit,  making  helmet  fit  and  weight  potential  critical 
issues.  In  addition,  part  of  the  advantage  of  HUDs  in  the  aircraft  results  from  the  sym¬ 
bology  that  can  be  made  to  conform  to  various  aspects  of  the  scene  (Weintraub  and 
Ensing,  1992).  For  example,  a  runway  with  associated  symbology  can  be  superimposed 
on  an  actual  runway  scene,  which  helps  to  integrate  the  two  sources  of  information  and 
reduce  attentional  interference  (Wickens  and  Andre,  1990).  Conversely,  it  is  difficult  to 


^  GOMS  is  an  acronym,  coined  by  Card,  Moran,  and  Newell  (1983),  that  stands  for  Goals,  Operators, 
Methods,  and  Selection  rules.  These  were  components  of  a  model  originally  intended  to  analyze  the 
routing  of  human-computer  interactions.  However,  the  GOMS  has  proved  to  be  more  general  and  has 
been  applied  to  variety  of  operator-machine  interface  issues. 
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imagine  how  this  sort  of  conformal  mapping  between  symbology  and  scene  features 
could  be  achieved  in  the  infantry  environment.  Therefore,  it  is  important  to  analyze  the 
use  of  different  displays  within  the  context  of  the  physical  and  task  environments  in 
which  infantry  soldiers  operate  (Blackwood  et  al,  1997). 

Blackwood  et  al.  (1997)  list  some  of  the  negatives  of  helmet-mounted  visual  dis¬ 
plays,  including  a  tendency  to  load  the  user  with  more  information  than  is  needed,  motion 
illusions  resulting  from  unstable  symbology,  soldier  disorientation,  and  loss  of  balance. 
They  propose  the  implementation  of  display  devices  that  provide  information  in  the  form 
of  enhanced  sensory  or  symbolic  displays.  In  the  proper  circumstances,  these  displays  can 
contribute  greatly  to  the  safety  and  effectiveness  of  the  dismounted  soldier.  In  addition, 
soldiers  using  display  equipment  will  often  be  in  dual-task  situations.  For  example,  a  sol¬ 
dier  may  be  navigating  terrain  with  the  aid  of  a  map  display  and  a  Global  Positioning 
System  (GPS)  when  an  auditory  message  comes  in.  The  message  has  to  be  checked  for  its 
importance  relative  to  the  navigation  task;  therefore,  the  speed  and  accuracy  of  response 
to  such  messages  would  be  expected  to  be  a  function  of  the  ease  of  using  the  map  system. 

d.  Evolving  First  Principles 

The  underlying  themes  contained  in  a  large  part  of  the  academic  literature  are 
concepts  of  iteration  (the  repeated  evaluation  and  refinement  by  potential  end  users)  and 
controlled  experimentation.  Tullis  (1988)  explained  that  interface  design  is  an  iterative 
and  dynamic  process  and  should  be  approached  as  such.  Toward  that  end,  the  literature 
review  has  yielded  several  recurring  design  practices  and  principles  for  both  display  and 
control  interfaces.  The  result  is  a  set  of  preliminary  design  principles: 

•  Understand  the  users  and  their  tasks  (Galitz,  1993). 

•  Involve  the  user  in  the  design  (Galitz,  1993). 

•  Test  the  system  on  actual  users  and  refine  as  necessary  (Galitz,  1993). 

•  Use  common  language  (Galitz,  1993). 

•  Provide  an  obvious  display  starting  point  (Galitz,  1993). 

•  Provide  consistent  component  locations  (Galitz,  1993). 

•  Provide  only  information  that  is  essential  to  making  a  decision  (Galitz, 
1993). 

•  Provide  all  data  related  to  one  task  on  a  single  screen  (Galitz,  1993). 
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•  The  display  formats,  language,  labels,  and  operation  of  the  computer  system 
should  be  consistent  throughout  the  course  of  the  dialogue  (Chao,  1986). 

•  Users  should  always  be  aware  of  where  they  are  in  a  transaction,  what  they 
have  done,  and  where  their  actions  may  have  been  successful  (Chao,  1986). 

•  Since  users  will  make  errors,  the  designer  must  have  a  system  for  detecting, 
communicating,  and  correcting  errors  (Chao,  1986). 

•  The  user  should  be  able  to  restart,  cancel,  or  change  any  item  in  an  entry 
before  or  after  the  “ENTER”  key  is  activated.  The  user  should  be  able  to 
abort  or  escape  from  a  partially  processed  entry  without  detrimental  effects  to 
the  stored  data  or  other  system  functions  (Chao,  1986). 

•  Representation  is  the  critical  aspect  of  interface  design.  Different  surface 
representations  of  the  same  content  (text,  graphics,  tabular,  numerals)  can 
oftentimes  yield  effortless  or  effortful  performance  (Norman,  1993). 

•  Visual  literacy  should  be  considered  in  design.  Nomic  capabilities  (e.g.. 
Gestalt  principles,  just  noticeable  differences  in  shading  and  texture)  provide 
innate  building  blocks  for  visual  displays  (Dondis,  1973). 

•  Avoid  distractions  (e.g.,  chart  junk,  color  pollution,  visual  clutter)  that  take 
away  from  the  efficacy  of  the  design.  Sometimes  less  is  more  (Tufte,  1983). 

•  Design  is  not  a  black  art.  Creative  design  can  be  accomplished  through  a 
phased,  structured  approach.  The  creative  leap  from  requirements  to  design  is 
facilitated  by  a  thorough  understanding  of  the  customer  or  user  (Toth, 
Hooton,  and  Graesser,  in  preparation). 

Relating  to  controls,  additional  questions  will  require  research  to  resolve.  Because 
of  the  complexity  of  ECS,  many  single  variables  need  assessment  by  research,  and  many 
tradeoff  functions  and  interactions  will  require  systematic  study  in  a  field  setting.  Eor 
example,  basic  questions  concern  how  a  given  control  will  be  put  to  use  and  additional 
crucial  questions  about  how  one  mode  of  use  relates  to  the  other  modes. 

It  seems  unlikely  that  there  is  a  single  location  (wrist,  helmet,  chest,  belt,  weapon 
stock,  and  so  forth)  where  the  full  complement  of  controls  can  be  located  without  penalty. 
It  seems  equally  unlikely  that  any  one  mode  (keyboard,  trackball,  voice,  and  so  forth) 
will  provide  the  ideal  means  of  control.  However,  trying  various  arrangements  in  the  field 
or  field-like  conditions  is  a  straightforward  test  project  that  could  lead  directly  to  a  mini¬ 
mally  disruptive  array  of  control  locations. 

Such  an  effort  would  be  congruent  with  the  goals  of  the  overall  ECS  program, 
which  is  to  give  the  dismounted  soldier  as  much  of  a  tactical  advantage  as  possible  while 
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not  adding  to  his  problems.  This  general  goal  also  leads  to  some  reasonable  specifications 
for  the  designers  of  the  controls: 

•  The  controls  should  be  kept  as  simple  (and  rugged)  as  possible  (Blackwood 
et  ah,  1997). 

•  They  should  also  be  protected  from  inadvertant  activation— by  the  soldier  or 
by  obstructions  in  the  environment— but,  at  the  same  time,  should  be  easily 
and  quickly  accessible  (Blackwood  et  ah,  1997). 

•  Whenever  possible,  there  should  be  strong  cues  to  the  function  over  which 
the  control  presides.  Such  cues  include  location  in  sets,  proximity  to  the 
device  being  controlled,  and  some  easy  abstraction  such  as  a  shape  cue  or  a 
color  coding  that  is  not  ambiguous  (i.e.,  red  =  stop)  (Blackwood  et  ah,  1997). 

4.  Summary  and  Future  Considerations 

The  aim  of  the  literature  review  is  to  examine  and  identify  issues  relating  to  inter¬ 
face  design  guidance  for  the  PCS  SMI.  Documents  are  being  continuously  obtained  and 
reviewed  for  utility.  The  pattern  emerging  from  the  military  sources  is  one  of  precise  and 
highly  detailed  design  guidance,  whereas  the  pattern  of  the  academic  sources  leans 
toward  philosophical  design  principles,  stressing  the  importance  an  iterative  process  of 
user  feedback  and  refinement  and  the  implementation  of  controlled  studies. 

One  potential  problem  with  the  literature  is  the  publication  genealogy.  While  the 
search  identified  a  significant  number  of  relevant  documents,  many  of  the  articles  have 
been  published  pre-1995,  before  the  Internet  boom  of  the  late  1990s.  It  is  quite  possible 
that  advances  in  computing  technology  have  made  much  of  the  display  research  outdated, 
and  the  next  generation  of  Web-based  research  underway  will  eventually  appear  in  the 
open  literature.  A  more  ecumenical  view,  however,  identifies  common  themes  no  matter 
what  date  of  research.  Prime  examples  are  the  desktop/window/menu/mouse  metaphors, 
which  have  not  changed  for  nearly  20  years  despite  the  fact  that  individual  instantiations 
of  the  metaphors  have. 

One  area  in  need  of  research  attention  is  the  hierarchical  ordering  of  information 
from  immediate  threat  to  minor  operational  concerns  and  evaluating  alternative  presenta¬ 
tion  sequences  and  formats  (Blackwood  et  ah,  1997).  Another  research  area  concerns  the 
allocation  of  information  to  visual  vs.  auditory  channels  and  the  applicability  of  advanced 
technology,  such  as  3-D  audio,  in  making  these  allocation  decisions.  Research  is  also 
needed  on  the  way  in  which  graphic  displays  are  structured  and  how  these  displays  are 
formatted  into  standard  iconic  symbols  for  action.  Blackwood  et  al.  (1992)  explain  that  it 
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is  possible  that  new  information-processing  and  display  capabilities  could  be  used  to 
reduce  stress  by  providing  a  global  help  function  (e.g.,  location  of  nearest  friendly  force) 
at  all  times.  Also,  a  critical  area  of  software  development  is  the  provision  of  this  infor¬ 
mation  in  a  secure  manner.  One  could  even  imagine  that  an  adaptive  interface  system 
could  also  be  used  to  on-load  the  soldier  during  periods  of  boredom  and  off-load  the  sol¬ 
dier  during  periods  of  high  workload  (Blackwood  et  ah,  1997). 

Ongoing  research  continues  to  examine  interface  issues  relating  to  control  and 
display.  The  literature  often  reveals  new  areas  for  exploration,  and  research  relevant  to 
the  PCS  will  be  incorporated  into  the  review  as  the  task  proceeds.  Current  reviews  are 
focused  on  interface  controls  as  a  way  of  optimizing  access  to  information.  Other  topics 
include  examining  the  concept  of  cultural  affordances  or  naturally  encoded  information 
and  determining  how  these  affordances  might  serve  to  reduce  the  cognitive  demands  on 
the  soldier.  Another  topic  for  future  review  is  that  of  augmented  reality,  or  the  superim¬ 
posing  of  audio  or  other  sense-enhancements  over  a  real-world  environment,  and  how 
this  display  might  aid  the  soldier  in  understanding  the  battlespace,  particularly  terrain 
(Goudeseune  and  Kaczmarski,  2001;  Hromadka,  2001). 

C.  RELEVANT  INTERFACE  CONCEPTS 

In  addition  to  approaches  and  guidance  related  to  interface  design  in  general,  sev¬ 
eral  actual  C4ISR  interface  concepts  are  relevant  to  the  PCS  problem.  Subsection  (II.C.l) 
identifies  and  describes  those  concepts,  and  Subsection  (II.C.2)  identifies  trends  in  design 
of  C4ISR  interfaces  and  discusses  the  application  of  trends  to  the  PCS  project. 

1.  Descriptions 

A  total  of  10  C4ISR  interface  concepts  have  been  developed  that  are  either  indi¬ 
rectly  or  directly  related  to  the  PCS.  These  concepts  are  described  below  in  approximate 
chronological  order  of  development  and/or  implementation. 

a.  Inter  Vehicular  Information  System  (I  VIS) 

The  IVIS  was  designed  as  a  command,  control,  and  communications  (C3)  aid  to 
enhance  the  situational  awareness  of  the  Abrams  tank  commander.  R&D  efforts  on  IVIS 
date  back  to  the  mid-1980s;  however,  IVIS  was  first  fielded  in  1992  when  it  was  incorpo¬ 
rated  into  the  vetronics  of  the  low-rate  initial  production  (LRIP)  versions  of  the  M1A2. 
Pielding  of  the  M1A2,  equipped  with  IVIS,  began  in  1996  with  the  P‘  Cavalry  Division. 
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The  IVIS  is  significant  to  the  history  of  NCW  because  it  was  the  first  attempt  to 
establish  horizontal  digital  links  from  direct-fire  platforms  to  artillery  and  aviation  sys¬ 
tems  (White,  2000).  Functionally,  IVIS  units  interconnect  similarly  equipped  M1A2 
tanks  at  the  level  of  the  battalion  and  below  (Dierksmeier  et  ah,  1999).  The  interconnec¬ 
tions  are  implemented  by  the  transmission  and  reception  of  digitally  encoded  signals  over 
the  Single-Channel  Ground  and  Airborne  Radio  System  (SINCGARS).  This  technology 
enables  the  M1A2  tank  commander  to 

•  Provide  continuously  updated  position  location  information  for  own  vehicles 
and  others  in  the  unit 

•  Send  and  receive  22  preformatted  reports,  including  spot  reports  and  calls  for 
fire 

•  Tansmit  and  receive  graphic  overlays  and  display  five  different  overlays  on 
each  IVIS  unit:  OPERATIONS  I,  OPERATIONS  2,  ENEMY,  EIRE 
SUPPORT,  and  OBSTACEE. 

Eigure  II-2  provides  two  views  of  IVIS.  In  the  left  panel,  the  IVIS  is  shown  as  it  is 
integrated  in  the  M1A2  Commander’s  Integrated  Display  (CID).  The  CID  includes  the 
Commander’s  Independent  Thermal  Viewer  (CITV)  and  the  Command  and  Control  Dis¬ 
play  (CCD),  which  includes  access  to/from  IVIS  and  the  GPS-based  Position  Navigation 
(POSNAV)  system.  The  right  panel  shows  a  close-up  of  the  IVIS  display.  This  particular 
graphic  is  a  screen  capture  taken  from  the  IVIS  Intelligent  Computer-Aided  Training 
(ICAT)  program.  Although  this  is  a  simulation,  it  is  intended  to  provide  a  high-fidelity 
emulation  of  the  IVIS  display  and  controls. 

The  M1A2  technical  manual  (Headquarters,  Department  of  the  Army,  1995)  pro¬ 
cedural  information  about  operating  and  maintaining  the  IVIS.  The  field  manual  for  the 
Abrams  tank  platoon  (Headquarters,  Department  of  the  Army,  1996)  provides  tactical 
information  about  employment  of  IVIS.  In  addition,  Wright  (2002)  recently  described 
some  detailed  tactics,  techniques,  and  procedures  (TTP)  in  which  he  emphasized  the 
potential  for  IVIS  as  a  navigation  aid. 

Although  the  IVIS  system  represents  a  relatively  primitive  interface,  it  is  signifi¬ 
cant  because  it  provided  a  baseline  approach  for  subsequent  systems,  including  the  PCS. 
PCS  developers  should  not  have  to  repeat  the  difficult  lessons  learned  through  20  years  of 
IVIS  R&D. 
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Figure  11-2.  Different  Views  of  the  iViS 


b.  Force  XXI  Battle  Command  Brigade  and  Below  (FBCB2) 

The  FBCB2  system  represents  an  evolution  of  the  interface  concepts  first  devel¬ 
oped  in  IVIS.  However,  it  differs  from  IVIS  in  several  key  ways: 

•  First,  the  connectivity  of  FBCB2  is  based  on  the  Tactical  Internet,  a  secure 
web-based  technology  derived  from  the  commercial  WWW.  The  Tactical 
Internet  consists  of  SINCGARS,  the  Enhanced  Position  Location  and 
Reporting  System  (EPLARS),  and  the  Internet  Controller  router. 

•  Second,  the  PBCB2  is  not  embedded  into  vehicle  systems;  rather,  it  is 
designed  as  an  applique  or  an  appended  technology.  Consequently,  PBCB2 
can  be  fitted  (and  retrofitted)  to  a  variety  of  combat  vehicles  and  stations. 

•  Third,  PBCB2  extends  connectivity  from  battalion  up  to  brigade  level.  As  a 
result,  PBCB2  represents  a  significant  increase  in  capability. 

•  Einally,  PBCB2  is  based  on  the  Tactical  Internet,  which  is  derived  from 
technology  developed  for  the  commercial  WWW  and  wireless  telephony. 
Because  the  interface  can  be  added  on  to  vehicles,  it  applies  to  a  potentially 
larger  variety  of  vehicles  and  other  stations.  Eor  instance,  it  is  estimated  that 
the  typical  brigade  will  have  over  1,000  PBCB2s  when  fielded. 

PBCB2  is  in  LRIP  and  is  currently  undergoing  advanced  soldier  testing  and 
evaluation  in  the  4*  Infantry  Division.  The  prime  contractor,  TRW,  has  received  an  order 
for  60,000  units  with  full-rate  production  (ERP)  contingent  upon  performance  during  Ini¬ 
tial  Operational  Test  and  Evaluation  (lOT&E)  scheduled  for  December  2001  at  the 
National  Training  Center  (NTC).  However,  this  large-scale  test  was  downgraded  to  a 
Limited  User  Test  (LUT)  when  the  DoD  Director  for  Operational  Test  and  Evaluation 
(DOT&E)  did  not  accept  the  Army’s  lOT&E  concept.  One  of  the  key  assumptions  of  that 
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concept  was  that  FBCB2  would  exchange  data  with  components  of  the  Army  Tactical 
Command  and  Control  System  (ATCCS).  Reports  indicated  that  components  of  the 
ATCCS  — in  particular,  the  Maneuver  Control  System  (MCS),  the  C2  system  for  brigade 
and  above— were  not  ready  for  lOT&E  but  that  the  FBCB2  had  performed  well  in  an 
electronic  warfare  environment  (“FBCB2  full-rate  ...”  2002).  Despite  delays  in  FRP, 
elements  of  the  FBCB2  continue  to  be  fielded  to  operational  units.  Under  the  program 
known  as  the  Balkan  Digitization  Initiative  (BDI),  the  U.S.  military  was  able  to  track  the 
location  of  700  vehicles  equipped  with  FBCB2  software  and  ruggedized  commercial 
hardware  (Kontron  Mobile  computers),  linked  by  a  Qualcomm  OmniTRACS  Ku-band 
satellite  system.  In  September  2002,  the  Army  approved  a  sole-source  contract  to  TRW 
to  equip  vehicles  operating  in  the  Persian  Gulf  region.  The  new  Gulf  Digitization  Initia¬ 
tive  (GDI),  which  is  similar  to  the  BDI,  will  link  200  vehicles  but  using  a  new  F-band 
satellite  hub  and  data  server  (Gourley,  2002). 

Figure  11-3  provides  two  views  of  the  FBCB2.  The  left  side  shows  the  three  com¬ 
ponents  of  the  system:  display,  processor,  and  keyboard.  The  right  side  shows  a  close-up 
of  the  display,  showing  several  software  buttons  controlled  by  keyboard,  mouse,  or 
thumbpad.  The  current  computing  environment  is  the  Intel  computer  running  a  Unix 
operating  system  (Bowers,  2002). 


Figure  11-3.  Different  Views  of  the  FBCB2 

FBCB2  is  key  to  the  project  because  it  represents  the  state-of-the-art  in  C4ISR 
interfaces.  The  FCS  interface  must  have  access  to  and  control  over  information  in  the 
FBCB2  and  that  Tactical  Internet  to  be  able  to  maintain  links  with  legacy  systems. 
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c.  Surrogate  digital  Command,  Control,  Communications,  and  Computer 
(SC4)  System 

The  Surrogate  digital  Command,  Control,  Communications,  and  Computer  (SC4) 
system  was  developed  as  part  of  Battle  Command  Reengineering  (BCR)  experimentation 
program  at  the  Mounted  Maneuver  Battle  Laboratory  (MMBL).  The  MMBL  [in  associa¬ 
tion  with  Illinois  Institute  of  Technology  Research  Institute  (IITRI),  AB  Technologies, 
Lockheed  Martin-Marietta,  and  other  supporting  contractors)  developed  the  SC4  to  be 
used  in  virtual  simulation  experiments  to  emulate  the  functions  of  an  advanced  C4ISR 
system  and  interface.  In  the  context  of  current  capabilities,  SC4  emulates  the  FBCB2  and 
the  other  five  components  of  the  ATCCS:  the  All  Source  Analysis  System  (AS AS);  the 
MCS;  the  Advanced  Field  Artillery  Tactical  Data  System  (AFATDS);  the  Forward  Area 
Air  Defense  Command,  Control,  Computers,  and  Intelligence  (FAADC3I);  and  Combat 
Service  Support  Computer  System  (CSSCS)  (Ray,  2000).  The  SC4  has  also  been  modi¬ 
fied  to  simulate  future  (post  2015)  C4ISR  capabilities,  including  automated  target  recog¬ 
nition  and  sensor  fusion  (Mounted  Maneuver  Battle  Laboratory,  2002). 

The  SC4  system  is  typically  installed  in  the  battalion  commander’s  simulated 
vehicle  and  those  of  his  staff  and  in  each  company  commander’s  simulated  vehicle.  The 
exact  components  of  SC4  have  differed  as  the  system  has  evolved  for  different  purposes. 
To  provide  an  example  SC4  configuration,  we  present  one  reported  by  Deatz  et  al.  (2000) 
in  Figure  II-4  and  describe  the  capabilities  of  its  components  below:  ^ 

•  A  C2  display.  This  display  provides  a  2-dimensional  (2-D)  top-down  view  of 
the  battlefield  derived  directly  from  the  the  Modular  Semi-Autonomous 
Forces  (ModSAF)  Plan  View  Display  (PVD). 

•  A  stealth  display.  This  display  provides  a  3-D,  360°  view  of  battlefield  from 
the  view  of  all  friendly  vehicles  and  detected  threat  vehicles. 

•  A  satellite  imagery  display.  This  display  emulates  the  capability  to  downlink 
imagery  directly  from  electro-optic  satellite  sensors  or  unattended  air  vehicles 
(UAVs). 

•  Video  teleconference  functions.  These  functions  provide  face-to-face  com¬ 
munication  between  the  commander  and  his  staff. 


3  In  addition  to  these  major  components,  the  SC4  includes  several  automated  tools,  including  those  for 
calculating  or  determining  unit  location,  line  of  sight  (LOS),  time-distance  measurements,  and  combat 
service  support  (CSS)  Class  III/V  consumption. 
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Figure  11-4.  Components  of  the  SC4  System 
(Source:  Deatz  et  al.  2000) 

•  A  collaborative  digital  environment.  This  environment  provides  e-mail  and 
virtual  whiteboard  capabilities. 

•  A  large  screen  display.  This  display  shows  a  3-D  representation  of  the  battle¬ 
field,  with  all  of  the  systems  that  are  visible  on  the  PVD,  Stealth,  Whiteboard, 
or  UAV  screens.  This  screen  also  includes  the  capability  to  automatically 
display  information  normally  contained  in  the  multiple  combined  obstacle 
overlay  (MCOO). 

The  fact  that  SC4  is  implemented  in  a  simulation  environment  limits  the  applica¬ 
bility  of  this  system  to  the  PCS  interface.  For  example,  the  simulation  environment  is 
relatively  benign,  so  the  systems  do  not  have  to  be  ruggedized.  As  implied  earlier,  SC4 
systems  also  can  be  reconfigured  rather  easily  to  incorporate  additional  capabilities  or 
technological  innovations.  Ray  (2002)  pointed  out  a  particularly  important  difference 
between  SC4  and  current  systems:  It  has  been  relatively  difficult  to  make  the  different 
components  systems  within  ATCCS  to  share  data.  In  contrast,  the  SC4  system  was 
designed  so  that  every  SC4  machine  is  able  to  display  and  transmit  the  same  data  to  any 
other  SC4  machine  on  the  network. 

Because  the  SC4  does  not  share  the  impediments  of  actual  C4ISR  systems,  it  is 
able  to  demonstrate  the  potential  advantages  of  such  systems  if  the  impediments  were 
rectified.  Subjective  appraisals  of  SC4  are  almost  universally  positive.  In  the  context  of 
simulation-based  experiments  at  the  MMBL,  the  impact  of  SC4  on  tactical  processes  and 
outcomes  has  been  nothing  short  of  revolutionary: 
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It  is  difficult  to  overstate  the  significance  of  the  SC4  in  the  operations  of  the  UA. 
The  SC4  was  the  central  technology  that  permitted  execution  focused  battle 
command  and  was  the  symbol  of  network  centric  warfare  at  the  UA,  Team,  and 
Cell  echelons.  It  provided  the  information  necessary  for  planning,  preparation, 
and  execution  of  tactical  missions  in  the  UA  and  did  so  in  a  graphic  representation 
that  was  tailorable  to  the  specific  user.  The  SC4  also  served  as  the  “gateway”  to 
information  from  tactical  electronic  mail  and  as  a  way  to  access  an  information 
data  base  that  contained  a  wide  breadth  of  information  on  enemy  forces,  their 
organization,  and  their  weapons.  This  data  base  also  included  record  copies  of 
operations  orders,  fragmentary  orders,  overlays,  collaborative  “white  board”  back 
briefs,  and  other  information  important  to  planning,  preparation  and  execution. 
All  of  this  was  available  to  anyone  with  an  SC4.  Because  of  those  capabilities,  the 
UA  never  conducted  “orders  groups”  or  meetings;  the  issuing  of  orders  and  the 
back  briefs  associated  with  them  was  done  over  the  information  network  with  the 
SC4.  Requests  for  information  (RFI)  from  the  UA  to  the  UE  were  made  — and 
fulfilled— using  tactical  electronic  mail  over  the  network.  As  a  result,  planning 
and  preparation  for  operations  was  significantly  reduced  from  current  timeframes 
to  around  two  hours.  Additionally,  the  UA  was  able  to  quickly  adjust  its  plans  to 
anticipate  enemy  actions  based  upon  the  common  relevant  battlefield  picture 
presented  across  the  UA  on  the  SC4:  execution-based  battle  command  became  the 
norm.  The  UA  “fought  the  enemy,  not  the  plan”  (Jarboe,  Ritter,  Hale,  and 
Poikonen,  2002,  p.  12-2). 

The  SC4  is  a  reconfigurable  system  that  continues  to  be  used  in  experimentation 
at  the  MMBL.  Results  from  those  experiments  provide  concepts  and  applications  that 
must  be  considered  for  any  ECS  interface. 

d.  Common  Army  Aviation  (AVN)  Situational  Awareness  (SA)  Soldier- 
Machine  Interface  (SMI) 

The  Common  Army  AVN  SA  SMI  currently  exists  as  a  preliminary  software 
requirements  specification  (SRS),  which  defines  the  requirements  for  common  SA  dis¬ 
plays  in  Army  aviation  platforms  (Program  Executive  Office  -  Aviation,  Aviation  Elec¬ 
tronic  Systems,  2001).  Another  purpose  of  the  SRS  is  to  ensure  the  interoperability  of 
aviation-to-ground  units  equipped  with  EBCB2  systems  (including  the  Tactical  Internet) 
by  providing  a  common  set  of  symbols  for  air  and  ground  entities.  The  SRS  applies  to 
interfaces  in  the  UH-60E-i-(M)  Black  Hawk  utility  helicopter,  the  OH-58D  Kiowa  recon¬ 
naissance  helicopter,  the  CH-47E  Chinook  cargo  helicopter,  the  AH-64D  Apache  attack 
helicopter,  and  the  RAH-66  Comanche  reconnaissance  helicopter.  The  display  imagery 
and  icons  for  the  AVN  SA  SMI  are  based  on  two  DoD  interface  standards:  MIE-STD- 
2525B.  Common  Warfighting  Symbology  (DoD,  1999)  and  MIE-STD-I787C,  Aircraft 
Display  Symbology  (DoD,  2001). 


11-31 


The  AVN  SA  SMI  displays  the  Aviation  Mission  Planning  System  (AMPS)  infor¬ 
mation  and  the  Joint  Variable  Message  Format  (JVMF)  messages  from  the  Tactical  Inter¬ 
net.  The  information  is  organized  into  “layers,”  which  the  aviator  can  select  or  deselect 
singly  or  in  combination  with  one  another. 

Figure  11-5  illustrates  several  default  layers:  Self  left),  Mission  (Aviation)  (top 
center),  and  Initial  Battlefield  Graphics  (top  right)  layers.  Updates  to  Initial  Battlefield 
Graphics  layer  are  obtained  from  JVMF  messages.  The  bottom  graphic  in  this  figure  is  a 
Default  layer  that  combines  information  from  the  Self,  Mission,  and  Initial  Battlefield 
Graphics  layers. 


Figure  11-5.  AVN  SA  SMI  Informational  Display:  Default  Layers 

Figure  IT6  shows  five  different  layers  pertaining  to  the  tactical  situation.  The  top 
row  displays  friendly  situation  graphics:  the  Friendly  Aircraft  (top  left)  Friendly  All  (top 
center),  and  Friendly  Air  Defense  Artillery  (ADA)  (top  right)  layers.  The  bottom  row 
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Figure  11-6.  AVN  SA  SMI  Informational  Display:  Layers  Pertaining  to  the  Tactical  Situation 

pertains  to  the  enemy  situation,  including  Enemy  All  (bottom  left)  and  Enemy  ADA  With 
Engagement  Rings  (bottom  right)  layers.  The  enemy  ADA  rings  indicate  the  maximum 
engagement  ranges  of  the  ADA  weapon  subtype  if  the  subtypes  are  known. 

Focusing  exclusively  on  display  issues,  the  AVN  SA  SMI  standards  do  not 
address  control  interface  matters.  Nevertheless,  these  standards  are  significant  for  at  least 
two  reasons.  First,  the  aviation  displays  are  focused  on  a  2-D  top-down  view  of  the  ter¬ 
rain,  emphasizing  the  land-centric  mission  of  Army  aviation.  Second,  the  AVN  SA  SMI 
provides  the  technology  for  current  aviation  systems  to  share  a  common  operating  picture 
with  FBCB2-equipped,  land-based  systems. 


e.  Rotorcraft  Pilot’s  Associate  (RPA) 

The  Army’s  RPA,  which  grew  from  the  Air  Force’s  Pilot’s  Associate  program, 
was  a  5-year,  $80-M  Advanced  Technology  Demonstration  (ATD)  conducted  from  1993 
to  1998  and  managed  by  the  Army’s  Applied  Technology  Directorate.  A  consortium  of 
contractors,  led  by  McDonnell  Douglas  Helicopter  Systems  (now  the  Boeing  Company), 
conducted  this  large-scale  effort,  which  involved  artificial  intelligence  (AI)  and 
state-of-the-art  computing  technology.  The  overall  purpose  was  to  increase  battlefield 
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SA,  lethality,  crew  system  performance,  and  survivability  of  the  next-generation  attack 
and  reconnaissance  helicopters  by  using  a  knowledge-based  cognitive  associate  to  fuse 
and  interpret  the  wide  range  of  sensor  information  impinging  on  future  attack  and  recon¬ 
naissance  aircraft.  One  aspect  of  the  information  management  problem  was  to  design  an 
adaptive  human  interface  that  automatically  selected  and  configured  information  to  be 
displayed  to  the  aviator.  The  system  was  flight  tested  in  1999  using  a  modified  AH-60 
Apache  attack  helicopter. 

One  of  the  RPA  major  components  is  the  Mission  Equipment  Package  (MEP), 
which  receives  and  integrates  the  more  than  12  sources  of  sensor  data  that  are  currently 
available  to  attack  helicopters.  These  data  are  fused  and  interpreted  by  the  Cognitive 
Decision  Aiding  System  (CD AS).  One  subcomponent  of  the  CDAS  is  the  Cockpit  Infor¬ 
mation  Management  (CIM)  module,  which  configures  and  controls  the  pilot  interface 
based  on  two  sources  of  knowledge  shared  with  other  CDAS  components:  (1)  the  Task 
Network,  which  represents  the  current  beliefs  that  the  CDAS  has  about  what  tasks  the 
pilot  is  performing  and  what  he  or  she  will  be  performing  in  the  immediate  future  and 
(2)  Context  Knowledge,  which  stands  for  the  CDAS’s  beliefs  about  the  current  state  of 
the  aircraft  and  the  external  world  (Punk  and  Miller,  1997).  While  tasks  proceed  in  par¬ 
allel,  the  CIM  prioritizes  and  filters  information  for  display  according  to  two  rules:  meet 
the  information  needs  of  the  most  important  tasks  first  and  do  not  exceed  the  workload 
and  display  capacities.  Using  this  information  and  logic,  the  CIM  performs  the  following 
interface-related  functions  (Miller  and  Punk,  2001): 

•  Page  (or  format)  selection.  Select  a  display  page  (e.g.,  weapons  or  sensors  on 
one  of  three  multifunction  visual  displays)  or  format  (e.g.,  visual  or  3-D 
auditory) 

•  Symbol  selection/declutter.  Turn  specific  symbols  ON  or  OPE  on  a  selected 
page. 

•  Window  placement.  Control  the  type  and  location  of  pop-up  windows  that 
overlay  information  in  multifunction  displays 

•  Pan  and  zoom.  Control  centering  and  magnification  of  maps  and  sensor 
displays 

•  Task  allocation.  Assign  tasks  among  two  human  pilots  and  an  automated 
“associate.” 


11-34 


Figure  II-7  graphically  depicts  the  RPA  interface.  The  graphic  in  the  left  panel  is 
a  photograph  of  RPA  multifunction  displays  as  installed  in  an  AH-60  prototype. 
Although  the  interface  includes  innovative  displays  and  controls  (e.g.,  voice  recognition, 
3-D  audio,  HMDs,  and  a  head/eye  tracking  system),  this  particular  figure  focuses  on  the 
multifunction  visual  displays.  The  graphic  in  the  right  panel  describes  the  Page  Selection 
function.  It  shows  the  configuration  of  the  three  multifunctional  screens  in  the  cockpit. 
The  right-panel  graphic  illustrates  how  one  of  these  displays  automatically  changes  on 
the  right  multifunctional  display  (RMFD)  (e.g.,  from  “Flight  Page”  to  Weapon  Page”)  as 
CIM  detects  a  change  in  task  (from  actions  on  contact  to  engage  a  target). 


Page  Selection  Overview 


Behavior  Description — 

-  CIM  selects  best  pages  and 
windows  for  current  tasks. 

-  CIM  selects  best  device  for 
presentation 

Example — 

-  Flight  Page  on  RMFD  during 
Actions  on  Contact 

-  Weapons  Page  on  RMFD  during 
Select  Appropriate  Weapon 

Payoff — 

-  Decreased  motor  taskload 

-  Faster  task  performance 

-  Decreased  errors  of  omission 


Flight 

Page 

Flight  Page  for 
Actions  on  Contact 


Weapons 

Page 

7 

Weapons  Page  for 
Select  Appropriate 
Weapon 


Figure  11-7.  The  RPA  Interface 

Note  for  Figure  11-7:  The  right  panel  is  from  Miller  and  Hannen,  1999. 

The  RPA  represents  several  different  innovations  in  interface  design,  but  perhaps 
its  most  important  contribution  is  the  use  of  adaptive  technology  (Scerbo  et  ah,  2001). 
Funk  and  Miller  (1997)  pointed  out  that  many  context-sensitive  displays  are  “adaptable,” 
meaning  that  human  input  is  needed  to  select  the  appropriate  mode.  The  problem  is  that 
human  selection  increases  the  workload  and  the  probability  of  error.  The  truly  “adaptive” 
nature  of  the  RPA  is  unique  because  the  process  of  selecting  information  and  configuring 
displays  based  on  context  is  completely  automated.  As  shown  in  Figure  IT7,  Miller  and 
Hannen  (1999)  suggested  that  the  payoff  of  an  adaptive  interface  is  decreased  motor  task 
load,  faster  task  performance,  and  decreased  errors  of  omission. 
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f.  Crew-integration  and  Automation  Testbed  Advanced  Technology  Dem¬ 
onstration  (CAT  ATD,  Unpublished  Briefing) 

The  CAT  ATD  is  currently  being  conducted  in  the  Vetronics  Technology  area  by 
the  U.S.  Army  Tank- automotive  and  Armaments  Command  and  Tank- Automotive 
Research,  Development,  and  Engineering  Center  (TACOM-TARDEC)  (TACOM- 
TARDEC,  2000).  The  CAT  ATD  is  an  outgrowth  of  the  earlier  Vehicle  Technology 
Testbed  (VTT)  and  incorporates  many  VTT  technologies.  The  purpose  of  this  ATD  is  to 
demonstrate  crew  interfaces  and  automation,  and  integration  technologies  requirements 
needed  to  operate  and  support  future  combat  vehicles.  Specifically,  the  CAT  ATD  is 
testing  a  multimission-capable,  2-man  crew  station  concept  that  embeds  control  of  both 
unmanned  aerial  vehicles  (UAVs)  and  unmanned  ground  vehicles  (UGVs).  The  ATD  was 
begun  in  EYOO,  and  successful  technologies  will  be  transitioned  to  the  future  ECS  dem¬ 
onstrator  at  Eort  Knox  in  EY04  (Joint  Robotics  Program,  2001). 

The  CAT  ATD  plan  for  calls  for  implementing  and  testing  several  SMI  technolo¬ 
gies,  including  interactive  touch  screens,  indirect  vision,  speech  recognition,  3-D  audio, 
head  trackers,  HMDs,  and  the  crewman  associate— an  adaptation  of  the  Al-based  tech¬ 
nology  developed  for  the  RPA.  The  SMI  design  is  notional  and  can  be  reconfigured  on 
the  basis  of  test  results.  The  concept  is  to  evaluate  SMI  concepts  in  the  context  of  a 
C- 130-transportable  test  vehicle,  as  depicted  in  the  left  panel  of  Eigure  11-8.  The  demon¬ 
stration  vehicle  is  fully  mobile  but  includes  a  safety  driver  to  sit  ahead  of  the  two  test 
crew  stations.  The  right  panel  of  Eigure  11-8  shows  a  single  crew  station.  The  configura¬ 
tions  of  three  screens  and  control  handles  serve  as  the  basic  I/O  devices  for  both 
operators.  Eigure  II-9  also  shows  a  close-up  of  the  control  screens.  As  illustrated  in  this 
figure,  the  display  configuration  changes  as  a  function  of  operator  roles  and  functions. 


Figure  11-8.  Views  of  the  CAT  ATD  Crew  Station 
in  Context  of  Test  Vehicie  (Left)  and  as  an  isoiated  System  (Right) 
(Source:  CAT  SMi  iPT,  n.d.) 
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Figure  11-9.  Close-Up  of  CAT  Screen  Configurations  for  Different  Roles  and  Functions 

(Source:  CAT  SMI  IPT,  n.d.) 

Although  the  CAT  ATD  is  an  experimental  system,  it  was  designed  to  be  directly 
applicable  to  the  PCS  project.  In  fact,  plans  call  for  promising  SMI  technologies  and  con¬ 
cepts  to  be  transitioned  to  future  improvements  of  PCS  (i.e.,  to  versions  after  Block  I). 

g.  Commander’s  Support  Environment 

The  goal  of  DARPA’s  PCS  Command  and  Control  (PCS  C2)  program  is  to  create 
a  C2  architecture  for  the  PCS  Unit  Cell  that  integrates  the  currently  stove-piped  battle¬ 
field  functional  areas  (BPAs)  into  a  single  information  environment,  the  Commander’s 
Support  Environment  (CSE)  (DARPA,  2002).  The  CSE  provides  an  advanced  C2  aid 
designed  to  free  the  commander  and  staff  from  routine  tasks  associated  with  operational 
planning  and  to  provide  execution  support  for  operational  exercises.  The  intent  is  to 
reduce  the  number  of  personnel  in  the  C2  element  of  the  PCS  Unit  Cell.  Traditionally,  the 
C2  staff  keep  track  of  their  individual  BPAs  and  integrate  information  through  communi¬ 
cation  with  the  other  staff  members.  The  PCS  C2  system  reduces  the  personnel  require¬ 
ments  by  automating  routine  staff  tasks  (e.g.,  map  posting,  route  planning)  and  by 
incorporating  a  knowledge  base  that,  in  real  time  and  in  a  single  environment,  integrates 
information  from  across  all  BPAs  relevant  to  the  planning  and  the  execution  phases  of 
battle.  The  CSE  provides  information  the  commander  and  staff  can  see  and  share  and  on 
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which  they  can  base  operational  decisions.  By  so  doing,  the  PCS  C2  converts  the  Army’s 
“...current  intense,  plan-centric  C2  process  into  an  execution-based,  battle-command 
process...”  (Gumbert,  Cranford,  Lyles,  and  Redding,  2003,  p.  81). 

As  illustrated  in  Figure  II- 10,  the  CSE  interface  has  a  Microsoft  Windows look- 
and-feel,  including  the  use  of  multiple  graphic  layers  and  windows-like  menus  and  tool¬ 
bars.  The  upper  left  screen  provides  a  screen  shot  of  the  Situation  Awareness  window 
that  provides  both  2-D  and  3-D  representations  of  the  battlespace.  This  window  displays 
and  differentiates  between  entities  derived  from  intelligence  templates  and  those  detected 
by  sensors  so  that  the  commander  can  develop  and  update  his  intelligence  preparation  of 
the  battlefield  (IPB)  in  real  time.  This  figure  also  shows  that  various  windows  can  be 
used  to  access  information  and  task  assets  across  all  BFAs.  Data  across  those  BFAs  are 
integrated  in  real  time  such  that  threat  detections,  classifications,  and  identifications  dis¬ 
played  in  the  Threat  Manager  Matrix  are  shared  with  the  Attack  Guidance  and  Battlefield 
Damage  Assessment  Matrixes  and  updated  based  on  how  systems  are  currently  employed 
and  on  battle  outcomes.  Furthermore,  all  the  tactical  information  is  derived  from  a 
physics-based  model  and  terrain  base  that  emulate  the  physical  environment  to  a  high 
degree  of  fidelity.  These  functions  allow  the  commander  to  plan  and  execute  missions. 
Planning  is  facilitated  by  the  ability  to  animate  friendly  and  enemy  movements  in  real 
time  or  in  fast  or  slow  motion.  Because  the  CSE  is  a  single  presentation  layer  for  all 
staffers  in  the  Unit  Cell,  it  promotes  shared  situational  understanding  and  the  ability  to 
conduct  parallel  planning. 

The  ECS  C2  program  developed  the  system  architecture,  implemented  it  in  a  Dis¬ 
tributed  Interactive  Simulation  (DIS)  environment,  and  executed  a  series  of  four  human- 
in-the-loop  (HITE)  experiments.  The  experiments  were  conducted  from  October  2001  to 
March  2003,  and  the  lessons  learned  were  passed  on  to  the  ECS  Eead  Systems  Integrator 
(ESI)  (Eickteig,  Sanders,  Eussier,  and  Sauer,  2003).  As  configured  for  the  ECS  C2 
experiments,  the  CSE  is  designed  for  four  key  members  of  the  ECS  Unit  Cell:  Com¬ 
mander,  Battle  Space  Manager,  Information  Manager,  and  Effects  Manager.  As  shown  in 
the  center  picture  in  Eigure  II- 10,  each  of  these  staff  members  is  provided  two  CSE  dis¬ 
plays,  which  are  configured  in  conformance  with  staff  functions  and  individual  prefer¬ 
ences.  In  addition  to  individual  monitors,  there  is  a  shared  head-up  display  on  which  staff 
members  can  share/broadcast  either  one  of  their  two  individual  displays. 
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Figure  11-10.  Various  Screens  From  the  CSE 
(Source:  Commander’s  Support  Environment  User’s  Guide,  2002) 


In  2002,  FCS  C2  was  selected  for  the  Army’s  C4ISR  “On  the  Move”  program, 
indicating  that  it  represented  the  “best  of  breed”  C2  technology  for  FCS  (Baumgardner, 
2002).  It  also  has  applications  to  Objective  Force  and  Agile  Commander  initiatives.  In  its 
present  form,  FCS  C2  is  configured  to  support  command-in-the-loop  simulations  of  the 
FCS  Unit  Cell,  the  lowest  tactical  command  echelon  in  the  Unit  of  Effect.  The  next  phase 
of  development  seeks  to  mature  FCS  C2  technology  by  expanding  its  capabilities  to 
include  operation  of  multiple  FCS-equipped  units  with  higher  headquarters,  dismounted 
soldiers,  and  connections  to  joint  forces. 


h.  Command  Post  of  the  Future  (CPOF) 

The  CPOF  is  an  ongoing  3-year  DARPA  project  that  was  initiated  in  February 
1999.  The  objectives  of  the  project,  through  the  use  of  advanced  visualization  technolo¬ 
gies,  are  to  increase  the  speed  and  quality  of  command  decisions,  disseminate  those 
commands  more  effectively,  and  decrease  the  size  and  increase  the  mobility  of  command 
structures  (Information  Exploitation  Office  [IXO],  DARPA,  n.d.). 


11-39 


The  initial  concept  of  CPOF  was  to  build  a  high-technology  C2  facility  for  land- 
based  forces  akin  to  combat  operations  centers  (COCs)  aboard  aircraft  carriers.  Senior 
military  advisors  to  the  project  vetoed  this  idea  in  favor  of  the  BattleBoard— a  handheld 
digital  device  designed  to  display  and  communicate  C2  information  and  knowledge 
(Waldrop,  2002).  Figure  II- 11  provides  a  rendering  of  this  portable  device. 


Figure  11-11.  Rendering  of  Proposed  BattieBoard  Device 
(Source:  Waidrop,  2002) 

Much  of  the  CPOF  work  concerns  the  presentation  of  useful  visual  information 
about  battlefield  terrain.  Figure  11-12  illustrates  some  of  the  proposed  terrain- viewing 
capabilities.  Most  tactical  views  are  top-down,  or  plan- view,  displays  with  contour  lines 
or  color-coding  to  describe  terrain  features.  CPOF  provides  several  enhancements  for 
understanding  subtle  features  of  the  terrain,  one  of  which  is  to  view  the  landscape  at  a 
continuously  variable  oblique  angle  in  addition  to  the  traditional  top-down  view. 

To  use  this  information  in  a  tactical  situation  (e.g.,  to  develop  military  COAs),  the 
commander  must  not  only  understand  the  tactical  situation,  but  must  also  communicate 
that  understanding  to  others  up  and  down  the  chain  of  command.  One  way  to  facilitate 
collaborative  understanding  is  to  provide  users  the  ability  to  tailor  their  own  visualization 
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Figure  11-12.  Various  Views  of  Terrain  in  CPOF  (Source:  Page,  n.d.) 

to  their  specific  situation  and  transmit  to  other  users.  Waisel  (2002)  pointed  out,  however, 
that  collaborative  understanding  requires  more  than  sharing  pixels.  It  also  requires  users 
to  share  data  objects  that  behave  logically  and  consistently  and  that  maintain  that  behav¬ 
ior  wherever  they  go.  Supporting  contractors  in  the  visualization  effort  include  Maya 
Viz.,  Ltd.;  Lockheed-Martin  Space  Systems  Company /University  of  Maryland;  Intermet¬ 
rics,  Inc.;  Visible  Decisions,  Inc.;  and  Sarnoff  Corporation 

Traditional  control  devices  (e.g.,  keyboard,  touch  screen,  mouse)  would  present  a 
potential  bottleneck  to  accessing  and  communicating  knowledge  from  the  system. 
Instead,  CPOF  is  developing  more  natural  interfaces  for  accessing  information  and 
knowledge.  Research  and  development  conducted  at  Carnegie  Mellon  University,  Massa¬ 
chusetts  Institute  of  Technology,  Northwestern  University,  Oregon  Graduate  Institute, 
and  the  University  of  Massachusetts  addresses  the  development  of  reliable  speech,  hand¬ 
writing,  and  gesture  recognition,  along  with  the  controlling  software  necessary  for  inte¬ 
grating  these  multiple  modes  of  input. 

The  CPOF  receives  information  from  a  number  of  tactical  sources,  including 
FBCB2  and  other  databases.  The  access  to  the  information,  including  visualizations,  is 
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controlled  through  a  dialog  management  process.  Similarly,  information  is  filtered  and 
interpreted  through  a  process  of  context  tracking,  which  adapts  the  presentation  to  fit  the 
immediate  situation.  Regarding  these  issues,  contractors  are  conducting  related  research 
on  knowledge-based  and  analogical  reasoning.  Supporting  contractors  include 
Boeing/East  Carolina  University;  General  Dynamics/Duke  University;  Cycorp;  MITRE 
Corp.;  and  Carnegie  Group,  Inc. 

Another  goal  of  the  CPOE  is  to  create  technologies  that  fit  and  support  actual 
cognitive  processes  used  to  make  tactical  decisions.  In  that  regard,  CPOE  is  supporting 
research  into  recognition-primed  planning  and  decision-making  models  developed  and 
promoted  by  Gary  Klein  and  Associates.  This  model  maintains  that  the  actual  decision¬ 
making  process  is  not  a  systematic  evaluation  of  mutually  exclusive  alternatives.  Rather, 
most  of  the  process  is  devoted  to  gaining  a  detailed  understanding  of  what  is  going  on 
(“situation  awareness”)  with  the  actual  decision  based  on  a  quick,  approximate  match  of 
the  current  situation  to  the  decision-makers  previous  experiences.  Thus,  the  CPOE  tech¬ 
nologies  are  designed  to  enhance  situation  understanding  but  do  not  provide  aids  for  sup¬ 
porting  formal  decision-making  processes  (e.g.,  utility  modeling). 

Although  the  CPOE  project  offers  some  innovative  control  technologies,  the 
major  implications  of  CPOE  technologies  for  the  present  ECS  interface  project  are  in  the 
area  of  display  and  visualization  concepts.  In  that  regard,  Waisel  (2002)  commented  that 
the  most  innovative  concept  from  the  CPOE  program  was  its  rejection  of  the  premise  that 
tactics  must  be  driven  by  a  Common  Operating  Picture  (COP)  — a  top-down  model  of 
ground  truth  that  can  be  shared  among  users  in  literal,  pixel-by-pixel  fashion.  Instead,  the 
CPOE  approach  is  to  implement  a  belief-based  Collaborative  Operating  Picture  (ColOP), 
which  is  superior  to  the  COP  in  the  following  ways: 

•  Multiple  beliefs.  Incorporating  multiple  beliefs,  instead  of  the  single  set  of 
“truths”  used  in  the  COP,  lessens  the  chance  of  overlooking  a  critical  piece  of 
information. 

•  Collaborative  pictures.  Building  collaborative  pictures  strengthens  team¬ 
building  processes. 

•  Private  views.  Allowing  users  to  maintain  private  views  separate  from  public 
views  permits  individuals  to  explore  their  own  hypotheses  about  the  tactical 
situation. 
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i.  Integrated  Mounted  Warrior  (IMW) 

The  purpose  of  the  IMW  program^  is  to  demonstrate  and  test  an  interface  that 
allows  the  mounted  crewman  to  access  and  control  FBCB2  and  vehicle  systems  while 
away  from  his  mounted  vehicle  crew  station.  The  program  is  jointly  sponsored  by  Pro¬ 
gram  Managers  (PMs)  for  the  Abrams  Tank,  Bradley  Fighting  Vehicle,  FBCB2,  and  the 
PM  Soldier  Systems.  A  consortium  of  contractors,  with  General  Dynamics  serving  as  the 
prime  developer  and  integrator,  is  developing  this  wireless,  voice-activated,  helmet- 
mounted  display  and  control  system.  The  contractor  team  also  includes  ITT  Industries  for 
voice  recognition  software,  TRW  for  FBCB2  interface  software,  and  Harris  Corporation 
for  the  secure  wireless  local  area  network  (LAN)  card. 

As  depicted  in  Figure  11-13,  the  test  vehicle  is  the  M1A2  System  Enhancement 
Program  (SEP)  tank,  but  the  system  is  potentially  applicable  to  other  fighting  vehicles 
such  as  the  Bradley,  the  Stryker,  or  future  PCS  vehicles.  Patterson  (2002)  identified  three 
components  of  the  IMW: 

1.  The  Wearable  Crewman  Computer.  Adding  about  6  lbs  in  equipment,  the 
Wearable  Crewman  Computer  comprises  the  HMD,  which  is  mounted  on  the 
standard  combat  vehicle  crewman  (CVC)  helmet,  and  the  load-bearing  vest, 
which  incorporates  the  portable  computer,  communications  security 
(COMSEC)  wireless  PAN,  cursor  controller,  and  battery. 

2.  The  Wireless  Communication  Gateway.  This  component  links  the  wear¬ 
able  computer  to  the  vehicle  electronic  and  communications  system.  It  is 
located  on  the  vehicle  bulkhead  at  the  commander’s  station  and  measures 
about  4  X  5  X  9  in. 

3.  The  Commander’s  Display  Unit/Commander’s  Electronic  Unit  (CDU/ 
CEU).  Pinked  with  the  Wireless  Communication  Gateway  via  the  Ethernet, 
the  CDU/CEU  processing  unit  includes  the  PBCB2  and  the  activation/control 
software. 

The  IMW  program  is  important  because  it  addresses  the  most  difficult  interface 
problem  for  PCS  — the  link  between  the  information  network  and  the  individual  dis¬ 
mounted  soldier.  Although  the  system  is  intended  for  the  vehicle  crewmen,  the  extensions 


4  The  IMW  program  was  previously  named  the  wireless  Tactical  Voice  Activation  System/Helmet- 
Mounted  Display  (TV AS/HMD). 
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Figure  II-13.  Conceptual  Diagram  of  IMW  Components 
(Source:  Patterson,  2000) 

and  applications  to  the  dismounted  infantry  soldier  are  obvious.  In  particular,  the  voice 
recognition  and  wireless  communication  technologies  are  particularly  relevant  to  the  PCS 
effort. 


j.  Warfighter-Machine  Interface  (WMI) 

The  WMI  is  currently  under  development  for  the  PCS  program  by  the  LSI,  a  con¬ 
tractor  team  led  by  Boeing  Corporation  and  Science  Applications  International  Corpora¬ 
tion  (SAIC).  General  Dynamics  Decision  Systems,  General  Dynamics  Robotics  Systems 
(and  including  its  subcontractor.  Micro  Analysis  and  Design),  and  Honeywell  Interna¬ 
tional,  Inc.,  are  assisting  the  LSI  in  its  effort  to  develop  the  WML 

Howard  and  Less  (2002)  indicated  that  the  WMI  provides  the  interactive  interface 
between  the  warfighter  and  the  rest  of  the  PCS  system,  including  unmanned  vehicles, 
ISR,  and  effects  systems.  However,  they  described  the  WMI  as  more  than  the  hardware 
and  software  related  to  displays  and  controls.  It  also  includes  the  software  architecture  to 
integrate  the  “...warfighters  visualization  and  interaction  needs  for  data  and  services 
across  all  manned  ground  vehicles  and  associated  off- vehicle  equipment”  (Slide  3  of  the 
presentation).  A  standard  set  of  APIs  will  be  developed  to  address  these  data  and  service 


11-44 


requirements.  These  requirements  are  based  on  detailed  use-cases,  which  include  services 
such  as  display  route,  enter  new  waypoint,  consent  to  fire,  display  sensor  video,  and  so 
forth.  However,  because  of  the  FCS’s  revolutionary  nature,  these  requirements  cannot  be 
pre-specified.  Consequently,  the  design  and  implementation  of  the  system  will  precede 
the  validation  of  all  requirements.  The  requirements  will,  in  essence,  emerge  as  the  sys¬ 
tem  develops  and  matures. 

The  emergent  nature  of  the  FCS  interface  requirements  requires  a  flexible  archi¬ 
tecture.  The  concept  for  this  architecture  was  described  in  a  briefing  by  Mark  Boyd  (n.d.) 
and  is  illustrated  in  Figure  11-14.  The  architecture  organizes  WMI  services  into  four 
layers: 

1.  Presentation.  This  layer  is  the  set  of  services  relating  to  communication  with 
the  human  operator  through  displays  and  controls. 

2.  Display  management.  This  layer  is  the  common  layer  across  systems  and 
pertains  to  services  related  to  initialization,  monitoring,  and  establishing  a 
common  look-and-feel. 

3.  Transition.  This  layer  includes  services  that  provide  plug-and-play  capabili¬ 
ties  for  role-specific  C2  applications. 

4.  Presentation  service  APIs.  This  layer  primarily  functions  to  isolate  the 
knowledge-  or  domain-independent  presentation  layer  from  the  domain- 
specific  C2  services. 

A  recent  DARPA  briefing  (“Concept  evaluation,”  n.d.)  described  the  evolution  of 
the  WMI  operator  display.  The  design  has  already  evolved  from  multiple  displays  in  the 
initial  concept  (Build  0)  to  an  integrated  display  (Build  1),  which  is  illustrated  in  Fig¬ 
ure  15.  As  shown,  this  display  is  organized  into  various  menus,  windows,  and  panels. 
Nevertheless,  the  dominant  display  is  the  terrain  view  in  the  center  of  the  screen. 

The  WMI  is  clearly  the  premier  program  for  investigating  and  developing  an  FCS 
interface.  This  program  intends  to  adopt  many  of  the  innovations  and  advances  described 
in  past  and  current  C4ISR  R&D  projects.  The  unique  advance  in  this  program  is  the  rec¬ 
ognition  that  software  architecture  is  key  factor  in  building  an  interface  for  a  system  of 
heterogeneous  systems. 
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Domain  Specific 
Plugins/Services  (Provided  by 
Domain  Vendors)  utilize  the 
Presentation  Service  API's  to 
convey  data  and  controls, 
receive  user  event  notification 


Figure  11-14.  Schematic  Representation  of  WMi  Architecture 
(Source:  Boyd,  n.d.) 
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Figure  11-15.  WMI  Build  1  Integrated  Display 
(Adapted  from  “Concept  Evaluation...,”  n.d.) 
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2.  Generalizations  and  Trends  in  Interface  Design 

These  10  interfaces  (reviewed  in  Il.C.l.a-II.C.l.j)  represent  a  variety  of 
approaches  and  technologies.  Nevertheless,  several  generalizations  and  trends  can  be 
noted  across  the  interfaces. 

All  interfaces  focus  on  some  representation  of  the  terrain,  which  is  an  obvious  and 
appropriate  orientation  for  land-based  forces  (Collins,  1998).  Over  time,  these  representa¬ 
tions  have  become  increasingly  sophisticated  and  based  on  more  detailed  terrain  data¬ 
bases.  The  CPOF  embodies  the  current  state-of-the-art  in  terrain  representation,  providing 
true  3-D  representations,  terrain  settings,  and  variable  viewing  angles. 

Display  technology  has  evolved  substantially  from  the  low-resolution,  mono¬ 
chrome  monitors  used  in  IVIS.  Since  that  time,  displays  have  employed  high-resolution, 
full-color  representations  of  the  battlespace.  HMDs  are  currently  under  investigation  in 
the  IMW  project,  and  alternative  interface  modes  (e.g.,  aural,  tactile)  are  being  consid¬ 
ered  in  the  CAT  ATD  and  the  WML 

Control  technology,  in  contrast,  has  evolved  more  slowly.  The  IVIS  relies  on  push 
button  inputs.  The  newer  interfaces  incorporate  standard  personal  computer  (PC)  input 
devices,  such  as  keyboards,  mouse  devices,  and  touch-sensitive  screens.  For  FCS  actors, 
these  standard  approaches  are  problematic  because  they  draw  attention  from  the  visual 
field  of  view  (FOV)  or  from  manual  actions.  In  that  regard,  IMW  program’s  investigation 
of  voice  recognition  controls  for  the  dismount  seems  particularly  promising.  The  IMW 
program  is  also  looking  at  eye-tracking  as  another  possible  control  mode.  The  possibility 
of  oral  control  devices  (e.g.,  “mouthsticks”)  has  curiously  not  been  pursued. 

None  of  these  interfaces  have  implemented  some  of  the  advanced  display  and 
control  technologies  developed  by  the  interactive  gaming  industry.  For  instance,  game 
“controllers”  are  often  integrated  I/O  devices,  including  information  such  as  tactile  and 
vibratory  cues.  Progress  has  probably  been  impeded  by  the  lack  of  formal  testing  and 
evaluation  of  these  technologies.  On  the  other  hand,  the  more  popular  game  controllers 
have  passed  one  of  the  severest  tests  of  operator  usability  (i.e.,  consumers  have  voted  for 
them  with  hard-earned  cash).  Developers  of  the  FCS  interface  should  examine  this  area 
for  potentially  valuable  applications. 
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The  most  recent  interfaces  employ  intelligent  software  agents.  To  date,  intelligent 
agents  have  been  used  to  perform  two  interface-related  functions: 

1 .  To  process  data  to  provide  warnings  and/or  interpretations  of  patterns, 
thereby  converting  information  into  knowledge  (e.g,  the  “Sentinels”  in 
CPOF) 

2.  To  adapt  the  display  configurations  automatically  (e.g.,  the  agents  in  the  CIM 
module  of  the  RPA). 

The  use  of  intelligent  agents  will  likely  increase  as  interfaces  become  more  com¬ 
plex  and  the  data  processing  pace  accelerates. 
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III.  MODEL  FOR  INTERFACE  DESIGN 


Based  on  the  literature  review  and  our  own  experience,  we  developed  a  general 
model  for  the  design  of  PCS  interfaces.  The  model  describes  general  relationships 
between  PCS  operator  requirements  and  interface  design  approaches.  Although  general  in 
nature,  this  model  was  used  to  derive  specific  guidelines  for  PCS  interface  design. 

A.  ASSUMPTIONS  AND  CONSIDERATIONS 

To  derive  the  model,  we  began  with  general  assumptions  and  considerations 
relating  to  fundamental  human  capabilities  and  limitations  and  to  specific  constraints 
imposed  by  the  PCS  operating  environment. 

1.  Limitations  on  Working  Memory 

Humans  are  limited  in  information  processors.  These  limitations  are  commonly 
attributed  to  constraints  in  working  memory,  the  seat  of  conscious  awareness  and  pro¬ 
cessing.  Any  PCS  interface  design  must  consider  the  limited  working  memory  resources. 

2.  Terrain  Focus 

The  logical  and  natural  focus  of  land-based  forces  is  on  the  terrain  (Collins, 
1998).  Lickteig  and  Throne  (1999)  recently  suggested  that  C2  displays  should  be 
designed  around  factors  of  mission,  enemy,  terrain,  troops,  and  time  (METT-T),  which 
includes  terrain.  The  ordering  of  factors  in  METT-T  is  appropriate  for  conducting  a  situa¬ 
tion  estimate  and  for  constructing  an  operations  order  (OPORD).  Por  interface  design, 
however,  we  suggest  that  the  factors  be  reordered  to  make  terrain  preeminent  [i.e.,  the 
acronym  should  be  redefined  as  T-METT  (terrain,  mission,  enemy,  troops,  and  time)]. 

3.  Display  vs.  Control  Functions 

Although  actual  interfaces  often  integrate  display  (output)  and  control  (input) 
functions,  distinguishing  those  two  functions  in  the  design  stage  is,  nevertheless,  useful. 
In  that  regard,  we  assume  our  goal  is  to  design  controls  that  optimize  operator  access  to 
information  and  knowledge  and  displays  that  optimize  operator  understanding. 
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4.  Shared  Understanding 

Given  the  diversity  of  functions  with  a  UA,  striving  for  operators  to  acquire  a 
common  or  shared  “mental  model”  of  all  roles  and  situations  is  neither  realistic  nor  use¬ 
ful.  Rather,  the  goal  is  for  operators  to  have  a  “shared  understanding”  of  the  high-level 
mission  objectives  and  their  role  in  achieving  those  objectives.  To  promote  this  under¬ 
standing,  displays  and  controls  must  be  consistent  and  interoperable  but  tailored  to  spe¬ 
cific  echelon  and  function. 

5.  Focus  on  the  Dismounted  Soldier 

The  intent  of  the  PCS  project  is  to  define  interfaces  for  all  echelons— from  the 
UA  commander  to  the  individual  dismounted  soldier.  In  accord  with  the  National 
Research  Council’s  Panel  on  Human  Factors  in  the  Design  of  Tactical  Display  Systems 
for  the  Individual  Soldier  (1997),  we  propose  that  the  lowest  echelon  presents  the  greatest 
challenge  for  interface  design.  Instead  of  applying  the  interfaces  designed  for  high-eche¬ 
lon  personnel  to  personnel  in  the  lower  echelons,  we  propose  to  start  with  the  lowest 
echelon  and  build  up. 

6.  Use  of  Advanced  Technology 

Our  survey  of  interface  technology  indicated  that  most  implemented  systems 
employ  conventional  technologies.  Table  IITl  compares  some  of  the  more  dominant  cur¬ 
rent  approaches  to  interface  design  with  the  corresponding  possible  future  approaches. 
FCS  interfaces  should  advance  the  state  of  the  art  and  employ  some  of  the  more  prom¬ 
ising  technologies. 

7.  Summary 

These  assumptions  and  considerations  suggest  that  the  FCS  SMI  design  must  be  a 
multiechelon,  soldier-centered  process  that 

•  Balances  operational  variables  with  a  4-D  battlespace  (3  spatial  dimensions 
plus  time) 

•  Employs  appropriate  sensory  and  response  modalities  to  optimize 
performance 

•  Develops  innovative  and  eclectic  display  and  control  technologies. 
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Table  III-1.  Comparison  of  Current  and  Future  Interface  Technologies 


Current  Approaches 

Future  Exemplars 

Visual  displays  augmented 
with  auditory  and/or  tactile 
cues 

•  Integrate  interface  modalities  by  function 

-  Vision  (planning) 

-  Audition  (guidance) 

-  Tactile  (warning) 

•  Introduce  additional  presentation  modalities 

-  Haptic  (pressure,  vibratory) 

-  Temperature 

-  Chemical  senses  (taste  and  smell) 

Manage  “translations”  in 
displays  by  selecting/ 
deselecting  features 

•  “Layered”  displays  to 

-  Declutter  irrelevant  information 

-  Redundantly  enhance  key  information 

Tailor  display  to  needs  of 
operator 

•  Automatic  active  configuration  of  displays  in  response  to 
situation 

•  Operator  selects  amount/type  of  information  in  display 

Manual/pedal  control  modes 

•  Head/eye-tracking 

•  Voice  recognition/control 

•  Tonguesticks 

Minimize  errors  through 
training  and  concept  of 
operations  (CONORS) 

•  Automated  error  detection,  communication,  correction 

•  Systems  to  prevent  or  warn  against  errors 

Ease  decoding  by  using 
common  language  and 
eliminating  unnecessary 
information 

•  Exploit  natural  and  cultural  affordances 

•  Intelligent  agents  to  convert  data  to  information 

•  Create  “instant  experts”  by  facilitating  development  of 
automated  processing 

Reduce  drain  of  resources 
by  time-shared  tasks 
through  overtraining 

•  Automation  routines,  intelligent  agent 

•  Expert  task-shedding  strategies 

Support  task/skill  retention 
by  overlearning  or  job  aids 

•  Embedded  training  and  simulation  (include  ability  to  practice 
“what  if”  scenarios) 

•  Intelligent  “helps”  that  sense  problems 

B.  TOWARD  AN  ONTOLOGY  OF  SOLDIER-CENTERED  DESIGN 

As  illustrated  earlier  in  Figure  II- 1  (Section  ILA.2),  the  design  process  is  medi¬ 
ated  by  four  sets  of  interacting  constraints: 
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1.  The  soldier.  Observable  capabilities  and  limitations  of  the  soldier  corres¬ 
ponding  to  general  and  specialized  processes  in  sensation,  perception,  atten¬ 
tion,  memory,  cognition,  emotion,  personality,  culture,  and  task. 

2.  The  environment.  Characteristics  of  the  environment  (e.g.,  terrain,  blue  and 
red  forces,  equipment)  within  which  the  soldier  is  situated  or  immersed  and  an 
understanding  of  how  the  soldier  interacts  with  these  characteristics. 

3.  The  state  of  the  art  and  practice.  In  soldier-machine  interfaces,  human- 
computer  interaction,  human  factors,  ergonomics,  and  other  relevant  topics  in 
cognitive  science  or  related  sciences. 

4.  Requirements.  Articulated  by  the  soldier,  leadership,  programmatic  con¬ 
straints,  and  other  constraints  because  of  lessons  learned  and  which  are 
documented  in  the  state  of  the  art  and  practice. 

1.  Disparate  Approaches,  Common  Goals 

The  goal  of  any  successful  design  should  be  to  provide  users  the  tools  and  pro¬ 
cesses  that  make  the  best  use  of  their  capabilities.  However,  given  the  fixation  on  the  vis¬ 
ual  and  auditory  modalities  (see  Section  II),  the  disembodied  nature  of  predominant 
theory,  and  set  against  the  war  fighter’s  needs,  the  FCS-SMI  faces  a  significant  prob¬ 
lem— an  incomplete  picture  of  the  soldier— and  is  now  poised  to  solve  that  problem. 

This  concept  is  further  illustrated  in  Figure  III-l.  the  flow  of  control  and 
data/information  between  external  representations  and  morphology  and  between  mor¬ 
phology  and  internal  representations  is  bi-directional.  This  underscores  the  transactional 
nature  of  the  model,  where  behavior  is  mediated  by  the  interface  and  constraints  intrinsic 
to  the  interface;  indicated  by  the  large  double-headed  arrow  in  the  left  of  Figure  III-l. 
Likewise,  internal  representations,  memory,  and  cognition  are  mediated  by  the  ongoing 
state  of  the  human’s  morphology,  indicated  by  the  other  double-headed  arrow  as  percep¬ 
tion  and  action.  This  approach  is  in  contrast  to  the  “Model  Human  Processor”  from  the 
Human-Computer  Interface  (HCI)  literature  (see  Figure  III-2),  which  led  to  the  GOMS 
method  of  analysis,  for  instance. 

Earlier  models  not  only  de-emphasized  the  role  of  the  limbs,  but  also  the  details 
of  early  and  middle  attentional  and  perceptual  processes.  The  models  were  extensions  of 
broader  cognitive  architectures,  such  as  Soar  or  ACT-R^;  however,  the  disembodied 


^  Soar  and  ACT-R  are  symbol  manipulation  architectures. 
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Figure  III-1.  Conceptualization  of  FCS-SMI  Soldier-Centered  Design  Ontology 


Figure  III-2.  Model  Human  Processor 
(Source:  Card,  Moran,  and  Newell,  1983) 

nature  of  these  models— operating  solely  in  the  realm  of  symbols,  much  like  variables  in 
a  programming  language— made  for  good  theory  but  failed  to  produce  working  systems, 
particularly  in  real-time  and  dynamic  environments.  Another  class  of  methods  (summa¬ 
rized  in  Appendix  A),  are  more  firmly  grounded  in  human  factors  and  ergonomics,  and 
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based  largely  on  behavioral  evidence,  cognitive  theory,  and  experience  from  the  devel¬ 
opment  of  industrial  products.  The  fixation  is  on  practice  and  not  on  theory.  Thus,  certain 
aspects  from  this  body  of  literature  can  be  applied  directly  to  most  if  not  all  this  design 
ontology. 

Finally,  a  third  class  of  theories,  exemplified  in  Carroll  (1991),  Nardi  (1996),  and 
Norman  (1993),  focus  on  aspects  of  the  human  that  may  have  been  overlooked  or  “dis¬ 
embodied”  in  other  traditions  of  human  factors  and  HCI.  One  such  central  idea  is  activity 
theory,  for  example,  which  pursues  the  notion  that  humans  engage  in  activities  that 
unfold  moment  by  moment  and  evades  description  as  static  symbolic  knowledge  struc¬ 
tures  or  cleanly  definable  models  of  boxed  processes.  Some  activities  are  considered 
emergent  and  are  the  result  of  the  transactions  between  humans  and  their  environments. 
In  fact,  Bartlett  had  pointed  this  out  in  the  1930s.  His  notion  of  the  schema  referred  to 
active  reconstruction  that  occurs  in  the  moment,  not  because  of  a  stored  plan.  Each  new 
action  is  unique  and  may  never  be  replicated.  In  the  extreme,  a  form  of  activity  theory 
known  as  situated  action  is  tantamount  to  anarchy  since  any  notion  of  a  pre-stored  plan 
or  knowledge  structure  in  computational  terms  is  stringently  eschewed  (among  the  best 
summaries  can  be  read  are  in  Nardi,  1996).  This  view  is  so  extreme  that  the  observed, 
verified,  and  replicated  notions  of  short-term  working  memory  and  long-term  memory 
have  no  place  in  the  analysis  of  the  here  and  now.  Cognitivism,  in  its  attempts  to  distance 
itself  from  behaviorism,  had,  in  a  complementary  way,  eschewed  the  role  of  the  environ¬ 
ment,  just  as  the  behaviorists  dismissed  the  contents  of  the  head. 

2.  Toward  an  Ecumenical  Approach 

Rather  than  throw  the  baby  out  with  the  bathwater,  a  more  reasonable  approach  is 
the  emphasis  on  the  morphology  and  how  it  relates  to  both  external  and  internal  repre¬ 
sentations  in  the  proposed  ontology.  When  analyzing  human  behavior  in  more  moderate 
forms  of  activity  theory,  the  role  of  the  environment  is  considered  as  being  as  important 
as  the  role  of  the  human;  however,  known  limitations,  including  short-term  working 
memory,  are  still  taken  into  account.  In  other  words,  the  unit  of  analysis  should  involve 
both  human  and  environment.  In  contrast.  Figure  III-2,  illustrating  the  Model  Human 
Processor,  is  a  diagram  of  a  push-button  device  and  a  finger  pushing  the  button,  but  the 
resulting  model  only  addresses  button-pushing  from  the  perspective  of  mental  structures. 
In  activity  theory,  descriptions  involve  the  device  and  the  human.  From  the  perspective  of 
the  proposed  ontology,  the  design  of  the  device  (as  an  external  representation),  the 
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makeup  of  the  human  (as  the  morphology)  and  the  internal  processes  (as  internal  repre¬ 
sentations)  have  equal  footing. 

Further  refining  this  analysis,  the  principal  design  attributes  pertaining  to  the  warfighter 
or  soldier  are  presented  in  the  columns  of  Table  III-2.  A  row  in  the  table  reflects  an 
instance  of  these  design  attributes.  The  totality  of  the  columns  and  rows  constitute  the 
“ontology”  — the  soldier’s  being— to  underscore  a  soldier-centered  design  philosophy. 
This  ontology  is  far  from  complete,  and,  ideally,  one  row  should  not  be  considered  in 
isolation  from  another.  These  interdependencies  will  ultimately  come  about  from  the 
evolving  composition  of  the  ontology  as  it  unfolds  during  future  phases  of  the  effort.  The 
ontology  should  not  be  confused  with  the  model,  which  is  presented  in  the  next  section. 
The  ontology  is  a  way  of  looking  at  soldiers,  their  requirements,  their  composition,  capa¬ 
bilities,  and  the  relationship  between  the  soldiers  and  the  environments. 

Columns  in  Table  IIT2  are  partitioned  into  three  groups:  (1)  external  representa¬ 
tions  and  events,  (2)  morphology,  and  (3)  internal  representation  and  processes.  These 
three  categories  underscore  the  dynamic  relationships  among  stimuli  in  the  environment 
that  are  identified  or  constructed  as  external  representations;  how  the  morphology  of  the 
human  interacts  or  interfaces  with  these  representations;  and  how  they  are  sensed,  per¬ 
ceived,  transformed,  maintained,  and  acted  upon  by  the  human  as  internal  representations 
and  processes  — more  specifically,  in  terms  of  memory  and  cognition.  External  repre¬ 
sentation  follows  its  received  interpretation  in  the  literature^.  Among  the  leading  exam¬ 
ples  are  problem  isomorphs  (Kotovsky  et  al.,  1985;  Zhang,  1991,  1997;  Zhang  and 
Norman,  1994;  Norman,  1993),  distributed  cognition  (Zhang,  1991,  1997;  Zhang  and 
Norman,  1994;  Norman,  1993;  Hutchins,  1990,  1995;  Flor  and  Hutchins,  1992),  diagram 
understanding  (Larkin  and  Simon,  1987;  Barwise  and  Etchemendy,  1994),  and  decision 
framing,  (Tversky  and  Kahneman,  1984;  Kahneman  and  Tversky,  1979)  Morphology  is 
simply  a  general  term  referring  to  the  various  human  organs,  limbs,  and  physiological 
subsystems  that  are  actively  engaged  when  interacting  with  a  dynamic  (externally 


^  The  concept  of  external  representation  was  first  introduced  as  “external  memory”  by  Newell  while 
proposing  the  Blackboard  architecture.  This  architecture  suggested  tools,  artifacts,  and  procedures  that 
are  maintained  in  the  environment  to  assist  human  limitations  and  the  ephemeral  properties  of  internal 
working  and  long-term  memory.  Norman  and  his  students,  however,  later  refined  the  concept  by 
proposing  external  features  that  map  (most  efficiently  according  to  design  principles  and  known 
human  capailities  such  as  automaticity)  to  these  various  internal  processes  (Norman,  1993). 
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Table  III-2.  Example  of  Soldier-Centered  Ontology— Mapping  External  to  Internal  Representations  via  Morphology 
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represented)  world  and  internal  features  of  human  memory  and  cognition.  Internal  repre¬ 
sentation  refers  to  the  various  internal  structures,  processes,  and  models  that  have  been 
identified  and  validated  over  the  past  century  of  research  through  observational  studies, 
practice,  computational  models,  or  working  systems.  The  notion  of  channel  is  derived 
verbatim  from  the  “attention”  literature  and  addresses  the  human  capability  to  sense,  per¬ 
ceive,  and  filter  different  types  of  external  stimuli  as  different  internal  codes  along  vari¬ 
ous  channels.  The  maintenance  and  selection  of  codes  on  these  channels  can  occur  in 
their  early  (sensory),  middle  (perceptual),  or  late  (conceptual)  forms.  The  combined  sense 
of  channel  and  code  and  how  they  become  activated  by  external  representations  in  a 
bottom-up  sense  or  by  internal  representations  in  a  top-down  sense  is  what  many  typi¬ 
cally  think  of  as  a  modality.  Figure  IIT3  elaborates  further  on  these  relationships. 


Figure  III-3.  Problem  Isomorphs  or  the  Mapping  Between 
Internal  Representations  and  Different  External  Representations 

Restated,  the  relevance  to  human  factors  and  the  SMI  is  identifying  as  many  par¬ 
allel  channels  as  possible  that  can  maintain  as  many  of  these  different  types  of  codes  on 
each  channel  (according  to  battlespace  complexity)  and  the  warfighter’s  echelon 
(according  to  the  soldier’s  task). 

Consider  the  last  row  of  Table  III-2,  for  example,  pertaining  to  environmental  and 
physiological  stressors.  The  first  column.  External  Representation,  summarizes  some  of 
the  better  known  stressors  including  hunger,  fatigue,  performance  enhancing  drugs,  and 
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NBC  agents.  This  entry  might  be  somewhat  misleading  since  the  representation  in  this 
case  is  actually  a  combination  of  stressor  and  features  of  a  task  performed  by  a  human  in 
a  certain  context.  However,  for  this  example,  the  emphasis  is  on  the  stressor.  Sometimes 
referred  to  as  “performance  moderators”  or  “behavior  moderators,”  a  significant  amount 
of  research  has  resulted  in  some  well-known  models,  some  of  which  are  summarized  in 
the  last  column.  Processes. 

Also  consider  soldier  fatigue,  a  performance-enhancing  drug,  and  the  Yerkes- 
Dodson  Law.  According  to  this  law,  which  assumes  the  shape  of  an  inverted  U,  perform¬ 
ance  is  optimal  at  the  top  of  the  inverted  U,  when  the  human  is  at  a  moderate  level  of 
arousal,  perhaps  because  of  a  low-to-moderate  dose  of  an  amphetamine.  A  fatigued  sol¬ 
dier  with  no  drug  is  probably  on  the  left-hand  portion  of  the  U.  In  this  fatigued  state  of 
nominal  arousal,  performance  will  suffer.  Likewise,  if  the  soldier  takes  too  much 
amphetamine  and  becomes  over-aroused,  performance  will  also  suffer.  The  analysis  does 
not  have  to  end  here  since  the  effects  of  certain  classes  of  drugs,  including  amphetamines, 
have  also  been  examined  with  respect  to  the  speed-accuracy  tradeoff  and  cognitive  per¬ 
formance.  Naylor,  Callaway,  and  Halliday  (1992)  and  Dellinger,  Taylor,  and  Richardson 
(1986),  for  instance,  have  isolated  the  effects  of  certain  drugs  on  different  phases  of  cog¬ 
nitive  processing  according  to  the  Sternberg  model  — some  affecting  speed,  others 
affecting  accuracy,  yet  others  affecting  both  speed  and  accuracy,  depending  on  the  pro¬ 
cessing  phase  affected  by  the  drug  [(1)  stimulus  encoding,  (2)  maintenance  of  the  stimu¬ 
lus  in  short-term  working  memory  (STWM)  and  search  of  long-term  memory  (LTM), 
(3)  selection  of  the  appropriate  response,  and  (4)  execution  of  the  response].  As  such, 
receiver  operating  characteristics  (ROCs)  of  different  soldiers,  performing  a  given  task, 
with  a  given  dose  of  amphetamine,  can  also  be  determined.  Some  may  be  fast  and  accu¬ 
rate,  others  may  be  fast  and  sloppy,  and  so  forth.  As  programmatic  details  and  require¬ 
ments  emerge  during  Phase  II,  given  what  is  known  about  Yerkes-Dodson, 
Speed- Accuracy  Tradeoff,  and  the  Sternberg  model,  to  name  a  few,  how  will  the  specifi¬ 
cation  and  development  of  appropriate  artifacts  and  processes  unfold  according  to  this 
broader  view?  This  example  does  not  even  begin  to  address  the  kinds  of  equipment  that 
might  be  appropriate  for  the  SMI,  but  the  point  is  that  different  theoretical  outlooks  will 
need  to  be  organized  within  this  proposed  ontology,  that  salient  characteristics  of  differ¬ 
ent  approaches  to  design  will  have  to  be  addressed,  and  that  the  user  should  assist  in  the 
definition  of  the  SMI  program  during  Phase  II. 
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3.  Informational  Equivalence 

Another  tenet  of  this  model  focuses  on  the  notion  of  “informational  equivalence,” 
(i.e.,  generating  different  surface  representations  — text  vs.  graphics,  different  graphical 
forms,  one  wording  vs.  an  alternate  wording,  and  so  forth— that  represent  or  stand  in  for  a 
canonical  or  uniform  deep  representation].  For  example,  tic-tac-toe  and  the  game  15  are 
graphics-based  visuospatial  and  text-based  versions— problem  isomorphs— of  the  same 
problem  (see  Figure  III-3.)  The  deep  representation  is  usually  cast  in  terms  of  the  prob¬ 
lem  space,  and  the  constituents  of  the  deep  representation  are  mapped  to  the  different  sur¬ 
face  constituents  of  each  kind  of  representation.  In  tic-tac-toe,  the  constituents  of  the 
visuospatial  surface  representation  are  the  three  rows  and  columns  of  the  grid  and  the  Xs 
and  Os  that  occupy  each  cell  in  the  grid.  In  the  game  15,  the  constituents  are  text  and 
numeric,  and  a  running  total  is  maintained  as  each  player  tries  to  generate  moves  that 
total  15. 

Research  since  the  1950s,  in  particular,  has  underscored  the  relevance  of  phases 
of  processing  and  the  effects  of  types  and  composition  of  stimuli— text,  graphics,  prob¬ 
lem  representation,  wording— on  solution  times  and  errors,  response  bias,  ease  of  recog¬ 
nition  or  recall,  and  understandability.  Some  important  principles  that  have  emerged  are 
the  choice  between  consistent  and  varied  mapping  of  stimuli,  semantic  congruity,  map¬ 
ping  of  text-based  rules  to  external  visuospatial  constraints;  reduction  of  “chart  junk,” 
“feature  bloat,”  “visual  clutter,”  and  “color  pollution”  (Tufte,  1983);  wording  of  scenarios 
on  response  bias  or  heuristics;  and  limited  domain  knowledge,  to  name  a  few.  As  a  result, 
the  tax  on  memory,  processing  efficiency,  and  problem  semantics  are  recurring  themes. 
In  general,  this  research  has  focused  on  combinations  on  stimuli  that  address  visual  and 
verbal  processing.  The  FCS-SMI  approach,  in  contrast,  will  require  the  consideration  of 
many  different  kinds  of  stimuli  and  morphologies  owing  to  the  demands  on  the  soldier’s 
capabilities.  The  model  presented  in  Section  III.B  underscores  the  need  for  nonvisual  and 
nonverbal  stimuli  when  these  two  channels  of  processing  are  either  inundated  by  battle- 
space  complexity  or  become  irrelevant  according  to  the  soldier’s  situation  or  echelon.  In 
comparison  to  disembodied  attempts  at  unification  (Newell  1990),  the  unifying  theme  in 
this  ontology  is  intended  to  be  “ecumenical”  and  seeks  to  integrate  features  from  any  and 
all  models,  techniques,  or  processes  that  have  demonstrated  efficacy.  In  the  literature,  for 
example,  situated  action  and  symbolic  cognition  appear  to  be  at  odds  — the  former 
addressing  deficits  in  the  latter,  the  latter  arguing  for  informational  equivalence  with  the 
former.  In  FCS-SMI,  both  situated  action  and  symbolic  cognition  are  considered 
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approaches  that  have  known  benefits  and  acknowledged  deficits,  yet  the  exclusion  of 
either  could  yield  significant  gaps  in  the  proposed  ontology.  FCS-SMI  does  not  have  the 
time  or  patience  for  this  kind  of  academic  infighting. 

C.  THE  DESIGN  MODEL 

The  proposed  model  is  based  on  the  interrelationships  among  four  sets  of  vari¬ 
ables:  (1)  operational,  (2)  battlespace,  (3)  sensor  modalities,  and  (4)  echelon.  In  its  sim¬ 
plest  form,  the  model  can  be  depicted  as  bivariate  relationship  between  situational 
complexity  and  information  processing  requirements  (see  Figure  III-4).  The  curve  repre¬ 
sents  the  “appropriate”  match  between  situational  complexity  and  human  information¬ 
processing  capabilities.  The  relation  is  thought  to  be  monotonic  and  increasing,  but  the 
exact  shape  is  unknown  (i.e.,  the  relationship  in  Figure  III-4  is  notional). 


Situational  Complexity 


Figure  III-4.  General  Form  of  the  Design  Model 

To  make  the  model  more  relevant,  the  abstract  axes  must  be  translated  into 
dimensions  that  are  more  operationally  significant.  In  the  first  example,  let’s  substitute 
echelon  (from  individual  soldier  to  UA  commander)  for  complexity.  The  rationale  is  that, 
compared  with  lower  echelons,  high  echelon  missions  are  larger  in  scope  and  involve  a 
greater  number  and  variety  of  operational  systems.  While  generally  increasing  in  com¬ 
plexity,  we  acknowledge  that  some  aspects  of  performance  at  higher  echelons  are 
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actually  easier  (e.g.,  while  higher  echelon  performers  face  more  large  and  more  complex 
situations,  they  generally  have  more  time  available  to  respond  than  do  their  lower  echelon 
counterparts.  Thus,  while  echelon  is,  in  actuality,  a  multidimensional  concept,  it  is  a  rea¬ 
sonable  surrogate  for  complexity. 

The  Y-axis  can  be  similarly  translated  to  more  meaningful  dimensions.  For 
instance,  the  requirements  can  be  translated  into  matching  processing  modality  capabili¬ 
ties.  Modalities  can  be  ordered  in  their  evolutionary  status.  The  chemical  senses  (taste 
and  smell)  represent  relatively  primitive  sensory  modalities  that  appeared  early  in  evolu¬ 
tionary  development  of  mammals.  Vision,  in  contrast,  is  the  most  sophisticated  modality 
and  appeared  relatively  late  in  evolution.  The  underlying  continuum  from  the  least  to  the 
most  complex  modalities  is  also  multidimensional  in  nature.  More  complex  modalities 
have  greater  processing  bandwidths  (an  advantage  to  performance),  but  they  also  require 
greater  processing  time  and  resources  (a  disadvantage). 

Figure  IIT5  provides  a  specific  instantiation  of  the  model  that  displays  appropri¬ 
ate  processing  modality  capabilities  as  a  function  of  echelon.  Again,  the  exact  shape  of 
the  curve  is  unknown,  but  it  indicates  generally  that,  whereas  the  more  sophisticated 
processing  modalities  (audition  and  vision)  are  appropriate  for  higher  echelons,  the  more 
primitive  modalities  (chemical  and  haptic  senses)  are  appropriate  for  lower  echelons. 
Further,  this  particular  relationship  depicts  a  discontinuity  corresponding  to  the  marked 
differences  between  the  operating  environments  of  mounted  and  dismounted  soldiers: 
Mounted  soldiers  operate  in  a  relatively  benign  environment,  with  limited  or  indirect  vis¬ 
ual  access  to  external  world.  Dismounted  soldiers,  in  contrast,  are  completely  immersed 
in  the  external  world.  The  dismounted  soldier  has  to  use  all  available  senses  and  should 
not  be  distracted  by  augmented  visual  or  auditory  presentations  that  could  distract  him 
from  this  rich  and  rapidly  changing  environment.  Thus,  the  primitive  modalities  are  par¬ 
ticularly  appropriate  for  the  “eyes  busy/ears  busy”  environment  of  the  dismount. 

The  relationship  depicted  in  Figure  IIT5  has  two  specific  implications  for  FCS 
interface  design.  First,  it  supports  the  current  vision-centric  approach  to  designing  C4ISR 
interfaces  for  the  commander  and  staff.  Second,  it  suggests  that  these  standard 
approaches  are  not  appropriate  for  lower  echelons— particularly,  the  dismounted  soldier. 

Situational  complexity  can  also  be  operationally  defined  by  the  two  discrete 
phases  of  battle:  planning  and  execution.  Compared  with  planning,  execution  is  more 
complex  on  several  dimensions:  greater  unpredictability,  severity  of  environmental 
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Figure  III-5.  Relationship  Between  Processing  Modality  and  Echelon 

conditions,  individual  stress,  and  so  forth.  Figure  III-6  displays  the  resulting  relationship 
between  sensory  modalities  and  phase  of  battle.  This  figure  depicts  an  interactive  rela¬ 
tionship  within  the  echelon,  where  the  previous  relationship  between  echelon  and  modal¬ 
ity  applies  to  execution  but  not  for  planning.  The  rationale  is  that  the  “eyes/ears-busy” 
environment  of  the  dismount  does  not  apply  to  planning.  Thus,  this  second  example 
illustrates  that,  for  planning  purposes,  the  visual  mode  may  be  appropriate  to  all  echelons. 

It  should  also  be  pointed  out  that  actual  processing  modalities  are  not  a  single 
point  along  a  processing  continuum,  as  indicated  in  Figures  IIT5  and  III-6.  For  example, 
auditory  processing  varies  greatly  in  complexity,  from  the  resource-intensive  processing 
required  to  understand  complex  oral  instructions  to  the  automated  response  to  a  warning 
buzzer.  Thus,  the  modalities  address  a  distribution  of  processing  requirements  and  capa¬ 
bilities  with  the  relative  positions  indicative  of  the  central  tendencies  of  those  distribu¬ 
tions.  These  concepts  are  illustrated  by  the  notional  triangular  distributions  depicted  in 
Figure  TTT-7. 

The  overlapping  distributions  in  Figure  III-7  also  suggest  that  the  choice  of 
modality  is  not  a  mutually  exclusive  one:  Just  as  some  level  of  visual  interface  processing 
is  appropriate  for  the  lowest  echelon,  some  level  of  chemical  and  haptic  processing  is 
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Figure  III-6.  Relationship  Between  Processing  Modality  and  Phase  of  Battle 


Figure  III-7.  Spread  of  Capabilities  Within  Each  of  the  Modalities 

suitable  for  the  highest  echelon.  In  other  words,  the  difference  among  echelons  is  one  of 
the  relative  importance  of  processing  modalities.  Also,  the  auditory  modality  was  located 
near  the  midpoint  of  the  spectrum  to  suggest  that  this  modality  is  important  to  all  echelon 
levels.  This  implies  that  auditory-based  representations  may  provide  the  common  repre¬ 
sentation  for  all  echelons  of  the  UA.  Although  this  could  be  considered  a  justification  for 
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traditional  radio  communications,  it  remains  to  be  seen  whether  this  representation  should 
be  based  on  analogue  frequency  modulation  (FM)  or  some  other  advanced  technology. 


D.  PRELIMINARY  GUIDELINES 

The  design  model  is  tentative  and  abstract  at  this  point  in  its  development.  Nev¬ 
ertheless,  it  provides  several  concrete  guidelines  for  the  design  of  the  FCS  interface. 

•  Critical  information  may  often  need  to  be  recoded  to  facilitate  communica¬ 
tion  among  echelons.  For  instance,  information  pushed  down  from  higher 
echelons  must  be  recoded  into  auditory  or  haptic  forms  to  augment  the 
detailed  terrain  information  available  to  the  individual  soldier.  Similarly, 
tactile  and  auditory  information  pushed  up  from  lower  echelons  should  be 
recoded  into  visual  forms  that  can  be  used  to  augment  graphic  tactical  dis¬ 
plays. 

•  Differences  among  echelons  in  information-processing  capabilities  are 
greatest  during  the  execution  phase  of  battle.  In  contrast,  during  the  planning 
phase,  the  amount  of  time  available  increases  so  that  visual  processing 
becomes  appropriate  for  all  echelons. 

•  The  auditory  modality  provides  a  connecting  link  for  mounted  and  dis¬ 
mounted  forces.  Audition  provides  a  practical  lingua  franca  for  all  elements 
of  the  UA  in  that  information  does  not  require  extensive  coding  or  decoding 
to  be  pushed  up  or  down  the  echelon. 

•  The  model  can  be  used  to  derive  recommended  modalities  of  interface 
representations.  Table  III-3  summarizes  several  implications  that  we  have 
discussed:  (1)  visual  displays  are  appropriate  for  planning  for  all  echelons, 
(2)  nonvisual  processing  (tactile,  aural)  are  appropriate  for  individual/small 
unit  dismounts  during  execution,  and  (3)  auditory  processing  is  the  common 
link  across  echelons  (and  phases). 


Table  III-3.  Recommended  Primary,  Secondary,  and  Tertiary 
Representation  Modalities  for  Echelon  and  Phase  of  Battle 


Phase  of  Battle 

Echelon 

Plan 

Execute 

UA 

Visual/Auditory 

Visual/Auditory 

Battalion 

Visual/Auditory 

Visual/Auditory 

Company 

Visual/Auditory 

Auditory  A/isual 

Platoon 

Auditory  A/isual 

Auditory/Tactile/Visual 

Individual 

Auditory  A/isual 

Tactile/Olfactory/Auditory 

III- 16 


REFERENCES 


Alberts,  D.S.,  Garstka,  J.J.,  and  Stein,  F.P.  (1999).  Network  centric  warfare:  Developing 
and  leveraging  information  superiority.  Washington,  DC:  C4ISR  Cooperative 
Research  Program,  Office  of  the  Assistant  Secretary  of  Defense  (C3I). 

Avery,  L.W.,  and  Bowser,  S.E.  (1992).  Human  factors  design  guidelines  for  the  Army 
Tactical  Command  and  Control  System  (ATCCS)  Soldier-Machine  Interface.  (AES- 
R-002).  Eort  Eewis,  WA:  Army  Tactical  Command  and  Control  System. 

Barwise,  J.  and  Etchemendy,  J.  (1994).  Hyperproof.  Stanford:  CSEI  Eecture  Notes.  New 
York:  Cambridge  University  Press. 

Baumgardner,  N.  (2002).  C4ISR  On-the-move  demonstrations  to  feature  wide-array  of 
technologies.  DDN  C4ISR  News.  Retrieved  December  30,  2002  from  the  Defense 
Daily  Network  Web  site:  http://www.defensedaily.com. 

Bowers,  P.  (2002).  The  TRW  Tactical  Systems  Division  builds  the  next  generation  of 
tactical  Army  operations  systems.  Crosstalk,  15,  14-15. 

Boyd,  M.  (n.d.).  PCS  CTD  WMI  Architecture.  [Briefing].  Arlington,  VA:  Defense 
Advanced  Research  Projects  Agency. 

Card,  S.K.,  Moran,  T.P.,  and  Newell,  A.  (1983).  The  psychology  of  human-computer 
interaction.  Hillsdale,  NJ:  Eawrence  Erlbaum  Associates,  Inc. 

Carroll,  J.M.,  and  McKendree,  J.  (1987).  Interface  design  issues  for  advice-giving  expert 
systems.  Communications  of  the  ACM,  30  (1),  14-31. 

Carroll,  J.M.  (Ed.)  (1991).  Designing  interaction:  Psychology  at  the  human-computer 
interface.  Cambridge,  UK:  Cambridge  University  Press. 

Chairman,  Joint  Chiefs  of  Staff  (2000).  Joint  Vision  2020.  Washington,  DC:  U.S.  Gov¬ 
ernment  Printing  Office. 

Chao,  B.P.  (1986).  Design  guidelines  for  human- computer  dialogues.  (SAND86-0259). 
Sandia  National  Eaboratories,  Albuquerque,  New  Mexico. 

Collins,  J.M.  (1998).  Military  geography  for  professionals  and  the  public.  Washington, 
DC:  National  Defense  University  Press. 

Commander’s  Support  Environment  (CSE)  User’s  Guide.  (2002). 

Crew  Integration  and  Automation  Testbed  (CAT),  Soldier-Machine  Interface  (SMI),  Inte¬ 
grated  Product  Team  (IPT)  Members  (n.d.).  Detroit,  MI:  U.S.  Army  Tank- Automo¬ 
tive  &  Armaments  Command  (TACOM),  RD&E  Center  (TARDEC),  Vetronics 
Technology  Area. 


Ref-1 


Crew-integration  and  Automation  Testbed  (CAT)  advanced  technology  demonstrator 
(2002).  [Briefing]  Retrieved  December  30,  2002,  from  the  Tank- automotive  and 
Armament  Command  Research,  Development,  and  Engineering  Center  (TACOM- 
TARDEC)  Web  site:  http://www.tacom.army.mil/tardec/vetronics/catatd.htm. 

Csikszentmihalyi,  M.  (1990)  Flow:  The  psychology  of  optimal  experience.  New  York: 
Harper  and  Row. 

Deatz,  R.C.,  Greene,  K.A.,  Holden,  W.T.,  Jr.,  Throne,  M.H.,  and  Eickteig,  C.W.  (2000). 
Refinement  of  prototype  staff  training  methods  for  future  forces.  (ARI  Research 
Report  1763).  Alexandria,  VA:  U.S.  Army  Research  Institute  for  the  Social  and 
Behavioral  Sciences. 

Defense  Advanced  Research  Project  Agency  (DARPA)  (2002).  DARPA  fact  file:  A  com¬ 
pendium  of  D ARP  A  programs.  Retrieved  January  29,  2003,  from  the  DARPA  Web 
site:  http://www.darpa.mil/body/NewsItems/pdf/DARPAfactfile.pdf. 

Dellinger,  J.A.,  Taylor,  H.A.,  and  Richardson,  B.C.  (1986).  Comparison  of  the  effects  of 
atropine  sulfate  and  ethanol  on  performance.  Aviation,  space,  and  environmental 
medicine,  Dec.  1986,  1185-1188. 

Department  of  Defense  (1997).  Department  of  Defense  design  criteria  standard:  Aircrew 
alerting  systems  (MIE-STD-411P).  Washington,  DC:  Author. 

Department  of  Defense  (1998).  Department  of  Defense  design  criteria  standard:  Human 
engineering  (MIE-STD-1472P).  Washington,  DC:  Author. 

Department  of  Defense  (1999).  Department  of  Defense  interface  standard:  Common 
warfighting  symbology  (MIE-STD-2525B).  Washington,  DC:  Author. 

Department  of  Defense  (2001).  Department  of  Defense  interface  standard:  Aircraft  dis¬ 
play  symbology  (MIE-STD-1787C).  Washington,  DC:  Author. 

Dierksmeier,  P.E.,  Johnston,  J.C.,  Winsch,  B.J.,  Eeibrecht,  B.C.,  Sawyer,  A.R.,  and 
Quinkert,  K.A.  (1999).  Structured  simulation-based  training  program  for  a  digitized 
force:  Approach,  design,  and  functional  requirements.  Volume  1  (ARI  Research 
Report  1737).  Alexandria,  VA:  U.S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences. 

Dondis,  D.A.  (1973).  A  primer  of  visual  literacy.  Cambridge,  MA:  Massachusetts  Insti¬ 
tute  of  Technology. 

FBCB2  full-rate  production  stalled.  (March  1,  2002).  Jane’s  Defence  Weekly. 

Elach,  J.M.,  and  Dominguez,  C.O.  (1995).  Use-centered  design:  Integrating  the  user, 
instrument,  and  goal.  Ergonomics  in  Design,  3  (3),  19-24. 

Elor,  N.V.  and  Hutchins,  E.  (1992)  Analyzing  distributed  cognition  in  software  teams:  A 
case  study  of  collaborative  programming  during  adaptive  software  maintenance.  In 
J.  Koenemann-Belliveau,  T.  Moher,  and  S.  Robertson,  (Eds.),  Empirical  Studies  of 
Programmers:  Fourth  Workshop.  Norwood,  NJ:  Ablex  Publishing. 


Ref-2 


Funk,  H.B.,  and  Miller,  C.A.  (1997).  “Context  sensitive”  interface  design.  In  Proceedings 
of  the  International  and  Interdisciplinary  Conference  on  Modeling  and  Using  Context 
{CONTEXT-97),  Rio  de  Janeiro,  Brazil:  Federal  University  of  Rio  de  Janeiro. 

Galitz,  W.O.  (1993).  User-interface  screen  design.  New  York,  NY:  John  Wiley  and  Sons. 

Goudeseune,  C.,  and  Kaczmarski,  H.  (2001).  Composing  outdoor  augmented- reality 
sound  environments.  In  Proceedings  of  2001  International  Computer  Music  Confer¬ 
ence,  Havana. 

Gourley,  S.  (September  25,  2002).  U.S.  Army  expands  battlefield  digitization.  Retrieved 
April  16,  2003,  from  the  Jane’s  Defence  Weekly  Web  site:  http://www.janes.com. 

Gumbert,  J.,  Cranford,  T.C.,  Lyles,  T.B.,  and  Redding,  D.S.  (2003).  DARPA’s  future 
combat  system  command  and  control.  Military  Review,  May-June.  79-84. 

Headquarters,  Department  of  the  Army  (1995,  July).  Operator’s  manual  (Volumes  I  and 
2)  for  tank,  combat,  full-tracked:  I20-mm  gun,  M1A2,  General  Abrams.  (Technical 
Manual  TM  9-2350-288-10-1/2).  Washington,  DC:  Author. 

Headquarters,  Department  of  the  Army  (1996,  April).  Tank  platoon  (Field  Manual 
FM  17-15).  Washington,  DC:  Author. 

Howard,  E.,  and  Less,  M.C.  (2002).  WMI  procurement  specification  kick-off  meeting. 
[Briefing].  Arlington,  VA:  Defense  Advanced  Research  Projects  Agency. 

Hromadka,  T.V.  (2001).  Lessons  learned  in  developing  human-computer  interfaces  for 
infantry  wearable  computer  systems.  In  Usability  evaluation  and  interface  design: 
cognitive  engineering,  intelligent  agents,  and  virtual  reality.  Volume  1.  Mahwah,  NJ: 
Lawrence  Erlbaum  Associates,  Inc. 

Hutchins,  E.  (1990).  The  Technology  of  Team  Navigation.  In  J.  Galegher.,  R.E.  Kraut, 
and  C.  Edigo,  (Eds.),  Intellectual  Teamwork.  Hillsdale,  N.J.:  LEA. 

Hutchins,  E.  (1995).  How  a  cockpit  remembers  its  speed.  Cognitive  Science,  19, 
265-288. 

Information  Exploitation  Office,  DARPA  (n.d.).  Command  Post  of  the  Future  (CPOF). 
Retrieved  December  31,  2002,  from  the  DARPA  Web  site: 
http://dtsn.darpa.mil/ixo/cpof.asp. 

Jarboe,  J.,  Ritter,  P.,  Hale,  T.,  Lewis,  J.  and  Poikonen  (2002).  Battle  Fab  Experiment 
Final  Report  (BEEF R)  for  Future  Combat  Command  and  Control  (FCC2),  Concept 
Experimentation  Program  (CEP  #01-1701).  Port  Knox,  KY:  Mounted  Warfare  Test¬ 
bed,  Mounted  Maneuver  Battle  Laboratory. 

Joint  Robotics  Program  (2001).  Joint  Robotics  Program  Master  Plan  2001.  Washington, 
DC:  Author. 

Jordan,  P.W.  (2000).  Designing  pleasurable  products.  Philadelphia,  PA:  Taylor  and 
Prancis,  Inc. 

Kahneman,  K.,  and  A.  Tversky.  (1979).  Prospect  theory:  An  analysis  of  decision  under 
risk.  Econometrica,  47,  263-291. 


Ref-3 


Kelley,  J.F.  (1984).  An  iterative  design  methodology  for  user-friendly  natural  language 
office  information  applications.  ACM  Transactions  on  Office  Information  Systems,  1 
(2),  26-41. 

Kelly,  K.  (1998).  New  rules  for  the  new  economy:  Ten  radical  strategies  for  a  connected 
world.  New  York:  Viking  Press. 

Kotovsky,  K.,  Hayes,  J.R.,  and  Simon,  H.A.  (1985).  Why  are  some  problems  hard?  Evi¬ 
dence  from  tower  of  Hanoi.  Cognitive  Psychology,  17,  248-294. 

Kroemer,  K.H.E.,  Kroemer,  H.B.,  and  Kroemer-Elbert,  K.E.  (1994).  Ergonomics:  How  to 
design  for  ease  and  efficiency.  Englewood  Cliffs,  NJ:  Prentice  Hall. 

Earkin,  J.  and  Simon,  H.A.  (1987).  Why  a  diagram  is  (sometimes)  worth  ten  thousand 
words.  Cognitive  Science,  ii(l),  65-99. 

Eaurel,  B.  (Ed.)  (1990).  The  art  of  human- computer  interface  design.  New  York,  NY: 
Addison-Wesley  Publishing  Company,  Inc. 

Eewis,  H.V.,  and  Eallesen,  J.J.  (1989).  Human  factors  guidelines  for  command  and  con¬ 
trol  systems:  Battlefield  and  decision  graphics  guidelines.  (Research  Project  89-01). 
U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences,  Alexandria, 
VA. 

Eickteig,  C.W.,  Sanders,  W.R.,  Eussier,  J.W.,  and  Sauer,  G.  (2003).  A  focus  on  battle 
command:  Euture  command  systems  human  systems  integration.  In  Proceedings  of 
the  2003  Interservice/Industry  Training,  Simulation,  and  Education  Conference. 
Arlington,  VA:  National  Training  Systems  Association. 

Eickteig,  C.W.,  and  Throne,  M.H.  (1999).  Applying  digital  technologies  to  training:  A 
focus  on  pictorial  communication  (Technical  Report  1097).  Alexandria,  VA:  U.S. 
Army  Research  Institute  for  the  Social  and  Behavioral  Sciences. 

Maslow,  A.  H.  (1970).  Motivation  and  personality  (2"‘*  Edition).  New  York:  Harper  and 
Row. 

Miller,  C.A.,  and  Eunk,  H.B.  (2001,  March).  Associates  with  etiquette:  Meta-communi- 
cation  to  make  human- automation  interaction  more  natural,  productive  and  polite.  In 
Proceedings  of  the  8th  European  Conference  on  Cognitive  Science  Approaches  to 
Process  Control.  Munich,  Germany:  European  Association  of  Cognitive  Ergonomics. 

Miller,  C.A.,  and  Hannen,  M.D.  (1999,  January).  User  acceptance  of  an  intelligent  user 
interface:  A  rotorcraft  pilot’s  associate  example.  In  Proceedings  of  1999  International 
Conference  on  Intelligent  User  Interfaces  (pp.  I09-II6).  Redondo  Beach,  CA:  Asso¬ 
ciation  of  Computing  Machinery. 

Mounted  Maneuver  Battle  Eaboratory  (2002).  UA  Concept  Experimentation  Program 
(CEP),  Battle  Lab  Experimentation  Einal  Report  (BEEER).  Eort  Knox,  KY:  Author. 

Nardi,  B.A.  (Ed.)  (1996).  Context  and  consciousness:  Activity  theory  and  human-com¬ 
puter  interaction.  Cambridge,  MA:  The  MIT  Press. 


Ref-4 


National  Research  Council  (1997).  Panel  on  human  factors  in  the  design  of  tactical  dis¬ 
play  systems  for  the  individual  soldier.  Tactical  displays  for  soldiers:  Human-factors 
considerations.  Washington,  DC:  National  Academy  Press. 

North  Atlantic  Treaty  Organization  (1990).  Military  symbols  for  land-based  systems 
(STANAG  2019).  Brussels,  Belgium:  Author. 

Naylor,  H.,  Callaway,  E.,  and  Halliday,  R.  (1992).  Biochemical  correlated  to  human 
information  processing.  In  P.A.  Vernon  (Ed.),  Biological  approaches  to  the  study  of 
human  intelligence  (333-373).  Norwood,  NJ:  Ablex  Publishing 

Newell,  A.  (1990).  Unified  theories  of  cognition.  Cambridge,  MA:  Harvard  University 
Press. 

Nielsen,  J.  (1995).  Usability  engineering.  New  York:  Academic  Press. 

Norman,  D.A.  (1993).  Things  that  make  us  smart:  Defending  human  attributes  in  the  age 
of  the  machine.  New  York,  NY:  Addison-Wesley  Publishing  Company,  Inc. 

Norman,  D.A.,  and  Draper,  S.W.  (Eds.)  (1986).  User-centered  system  design:  New  per¬ 
spectives  on  human-computer  interaction.  Hillsdale,  NJ:  Eawrence  Erlbaum  Associ¬ 
ates,  Inc. 

Norman,  K.E.  (1991).  The  psychology  of  menu  selection:  Designing  cognitive  control  at 
the  human/ computer  interface.  Norwood,  NJ:  Ablex  Publishing  Corporation. 

Page,  W.  (n.d.).  Command  post  of  the  future.  [Briefing].  Washington,  DC:  Information 
Exploitation  Office,  DARPA. 

Patterson,  M.  (2002).  Wireless  Tactical  Voice  Activation  System! Helmet-Mounted  Dis¬ 
play  (TVAS/HMD)  program.  [Briefing].  Sterling  Heights,  MI:  General  Dynamics 
Eand  Systems. 

Program  Executive  Office  -  Aviation,  Aviation  Electronic  Systems  (2001).  Preliminary 
Software  Requirements  Specification  (SRS)  for  the  Common  Army  Aviation  Situ¬ 
ational  Awareness  (SA)  Soldier  Machine  Interface  (SMI)  (Coordinating  Draft).  Red¬ 
stone  Arsenal,  AE:  Author. 

Ray,  D.  (2000,  November).  Final  report:  Battle  Command  Reengineering  4.  Eort  Knox, 
KY:  Mounted  Maneuver  Battle  Eaboratory. 

Scerbo,  M.W.,  Ereeman,  E.G.,  Mikulka,  P.J.,  Parasuraman,  R.,  Di  Nocero,  E.,  and  Prin- 
zel,  E.J.  Ill  (2001,  June).  The  efficacy  of  psychophysiological  measures  for  imple¬ 
menting  adaptive  technology  (NASA/TP-200I-2I1018).  Hampton,  VA:  National 
Aeronautics  and  Space  Administration. 

Shepard,  A.P.  (1991).  Report  of  results  of  ATCCS  Contingency  Force  Experiment-Light 
(ACFE-L)  Group  B,  Soldier-Machine  Interface  (SMI)  Assessment  (AES-91-02).  Eort 
Eewis,  WA:  Army  Tactical  Command  and  Control  System. 

Tank- automotive  and  Armament  Command  Research,  Development,  and  Engineering 
Center  (TACOM-TARDEC)  (2002,  September).  Crew  Integration  and  Automation 


Ref-5 


Testbed  (CAT)  Advanced  Technology  Demonstration.  Retrieved  December  30,  2002, 
from  the  TACOM-TARDEC  Web  site: 
http://www.tacom.army.mil/tardec/vetronics/catatd.htm 

Toth,  J.,  Hooton,  S.,  and  Graesser  A.  (in  preparation).  A  proposed  model  for  mixed-mode 
communication  design  standards  via  cognitive  readiness  in  advanced  distributed 
learning  (Draft  IDA  Document).  Alexandria,  VA:  Institute  for  Defense  Analyses. 

Tufte,  E.R.  (1983).  The  visual  display  of  quantitative  information.  Cheshire,  CT:  Graph¬ 
ics  Press. 

Tullis,  T.S.  (1988).  Screen  design.  In  M.  Helander  (Ed.),  Handbook  of  human-computer 
interaction.  North-Holland:  Elsevier  Science  Publishers  B.V. 

Tversky,  A.  &  Kahneman,  D.  (1984).  Choices,  values,  and  frames.  American  Psycholo¬ 
gist,  39,  341-350 

Vygotsky,  E.S.  (1962).  Thought  and  language.  Cambridge,  MA:  The  MIT  Press. 

Waisel,  E  B.  (2002).  DARPA’s  Command  Post  of  the  Euture  (CPOE)  program.  In  Pro¬ 
ceedings  of  the  2002  Conference  of  Scuola  Superior e  G.  Reiss  Romoli  (SSGRR-2002). 
E’Aquila,  Italy:  Telecom  Italia  Group. 

Waldrop,  M.M.  (2002).  Cutting  through  the  fog  of  war.  Retrieved  December  31,  2002, 
from  the  Business  2.0  Web  site: 

http://www.business2.eom/articles/mag/0.1640.36729.EE.html. 

Weintraub,  D.J.,  and  Ensing,  M.  (1992).  Human-factors  issues  in  head-up  display  design: 
The  book  of  HUD.  (CSERIAC  Report  Number  20  92-2).  Wright-Patterson  Air  Eorce 
Base,  OH:  Armstrong  Medical  Research  Eaboratory. 

White,  A.  (2000).  Digital  battle  staff  training  deficiencies  and  mission  essential  task  list 
mapping  (lAT.R  0222).  Austin,  TX:  Institute  for  Advanced  Technology,  University 
of  Texas  at  Austin. 

Wickens,  C.D.,  and  Andre,  A.D.  (1990).  Proximity,  compatibility,  and  information  dis¬ 
play:  Effects  of  color,  space,  and  objectness  of  information  integration.  Human  Fac¬ 
tors,  32,  61-77. 

Wright,  S.  (2002).  The  M1A2  and  the  IVIS.  News  from  the  Front  [On-line  publication], 
Mar-Apr^  33-34.  Retrieved  December  23,  2002  from  Center  from  Army  Eessons 
Eearned  Web  site:  http://call.army.mil/products/pdf/nftf/marapr02/marapr02bk.pdf. 

Zhang,  J.,  and  Norman,  D.A.  (1994).  Representations  in  distributed  cognitive  tasks.  Cog¬ 
nitive  Science,  18,  87-122. 

Zhang,  J.  (1997).  The  nature  of  external  representations  in  problem  solving.  Cognitive 
Science,  21,  179-217. 

Zhang,  J.  (1991).  The  interaction  of  internal  external  representations  in  a  problem  solving 
task.  In  Proceedings  of  the  13"'  Annual  Conference  of  the  Cognitive  Science  Society, 
Chicago,  IL,  954-958.  Hillsdale,  NJ:  Eawrence  Erlbaum  Associates,  Inc. 


Ref-6 


GLOSSARY 


2-D 

two-dimensional 

3-D 

three-dimensional 

4-D 

four-dimensional 

ACFE-L 

ATCCS  Contingency  Eorce  Experiment-Eight 

ACM 

Association  for  Computing  Machinery 

ADA 

Air  Defense  Artillery 

AES 

ATCCS  Experimentation  Site 

AEATDS 

Advanced  Eield  Artillery  Tactical  Data  System 

AEV 

Armoured  Eighting  Vehicle 

AI 

artificial  intelligence 

AIAA 

American  Institute  of  Aeronautics  and  Astronautics 
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Battle  Command  Reengineering 
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Blue  Eorces 

BMS 

Battle  Management  Systems 
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C2 

command  and  control 
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command,  control,  and  communications 
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command,  control,  communications,  and  computers 
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command,  control,  communications,  computers,  and 
intelligence 
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command,  control,  communications,  computer, 
intelligence,  surveillance,  and  reconnaissance 

CAT 

Crew-integration  and  Automation  Testbed 
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Commander’s  Display  Unit/Commander’s  Electronic  Unit 
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Cognitive  Engineering  Laboratory  (University  of  Toronto) 

CEP 

Concept  Experimentation  Program 
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Computer-Human  Interaction 
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Cockpit  Information  Management 
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Commander’s  Independent  Thermal  Viewer 

CJCS 

Chairman  of  the  Joint  Chiefs  of  Staff 
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Carnegie  Mellon  University 
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course  of  action 
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combat  operations  center 
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Collaborative  Operating  Picture 

COMSEC 

communications  security 
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concept  of  operations 
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Common  Operating  Picture 
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Command  Post  of  the  Euture 

CSE 

Commander’s  Support  Environment 

CSERIAC 

Crew  System  Ergonomic  Information  Analysis  Center 
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Center  for  the  Study  of  Language  and  Information 
(Stanford  University) 
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combat  service  support 
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Combat  Service  Support  Computer  System 

GL-2 


CTD 

Concept  and  Technology  Demonstration 

CU 

Cornell  University 

cvc 

combat  vehicle  crewman 

DARPA 

Defense  Advanced  Research  Project  Agency 

DCIEM 

Defence  and  Civil  Institute  of  Environmental  Medicine 

DDN 

Defense  Daily  Network 

DISA 

Defense  Information  Systems  Agency 

DIVA 

Data  Intensive  Architecture 

DoD 

Department  of  Defense 

DOT 

Department  of  Transportation 

DOT&E 
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DTIC 

Defense  Technical  Information  Center 

EPEARS 

Enhanced  Position  Eocation  and  Reporting  System 

EAA 

Eederal  Aviation  Administration 
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Eorce  XXI  Battle  Command  Brigade  and  Below 
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ECS  Command  and  Control 

ECS 

Euture  Combat  Systems 

EERDC 

Eederally  Eunded  Research  and  Development  Center 

EM 

Eield  Manual 
frequency  modulation 

EMTV 

Eamily  of  Medium  Tactical  Vehicles 

EOV 

field  of  view 

ERP 
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EY 

fiscal  year 

CDI 

Gulf  Digitization  Initiative 

GOMS 

Goals,  Operators,  Methods,  and  Selection  (rules) 

GPS 

Global  Positioning  System 

GUI 

graphic  user  interface 

HCI 

Human-Computer  Interface 

HECS 

Human  Eactors  of  Command  Systems 

GL-3 
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HIRE 

HITE 

HMD 

HMMWV 

HUD 

EO 

lAT 

ICA 

ICAT 

IDA 

lEA 

lEAC 

lEIP 

lEORS 

IITRI 

IMS 

IMW 

lOT&E 

IPB 

ISR 

ISWC 

ITA 

IVIS 

IXO 

JV 

JVME 

EAN 

EOS 

ERIP 

ESI 


Human  Eactors  and  Ergonomics  Society 

Haptic  Interface  Research  Eaboratory  (Purdue  University) 

human-in-the-loop 

helmet-mounted  display 

High-Mobility,  Multipurpose  Wheeled  Vehicle 

heads-up  display 

input/output 

Institute  for  Advanced  Technology,  University  of  Texas  at 
Austin 

International  Conference  on  Auditory  Display 
Intelligent  Computer-Aided  Training 
Institute  for  Defense  Analyses 

International  Ergonomics  Association 

International  Eederation  of  Automatic  Control 

International  Eederation  for  Information  Processing 
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Intelligent  Munitions  System 

Integrated  Mounted  Warrior 
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intelligence  preparation  of  the  battlefield 

intelligence,  surveillance,  and  reconnaissance 
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line  of  sight 
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LTM 

long-term  memory 

LUT 

Eimited  User  Test 

MC2 

Mobile  Command  and  Control 
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Marine  Corps  Reference  Publication 

MCS 

Maneuver  Control  System 

MEP 

Mission  Equipment  Package 

METT-T 

mission,  enemy,  terrain,  troops,  and  time 

MIE-HDBK 

Military  Handbook 

MIE-STD 

Military  Standard 

MIT 

Massachusetts  Institute  of  Technology 

MMBE 

Mounted  Maneuver  Battle  Eaboratory 

ModSAE 

Modular  Semi- Autonomous  Eorces 

MOPP 

mission-oriented  protective  posture 

MSIS 

Man-Systems  Integration  Standards 

n.d. 

no  date 

NASA 

National  Aeronautics  and  Space  Administration 

NATO 

North  Atlantic  Treaty  Organization 

NBC 

nuclear,  biological,  and  chemical 

NCW 

Network  Centric  Warfare 

NEOS 

Non  Eine  of  Sight 

NPRDC 

Navy  Personnel  Research  and  Development  Center 

NTC 

National  Training  Center 

OPEOR 

opposing  force 

OPORD 

operations  order 

Ops 

operations 

OT&E 

operational  test  and  evaluation 

PC 

personal  computer 

PCIS 

Portable  Common  Interface  Set 

pic 

Public  Eimited  Company  (United  Kingdom) 

PM 

Program  Manager 

PNE 

Pacific  Northwest  Eaboratory 

POC 
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POSNAV 

Position  Navigation 

PPA 

Product  Personality  Assignment 

PVD 

Plan  View  Display 

R&D 

research  and  development 

RDT&E 

research,  development,  test,  and  evaluation 

RFI 

request  for  information 

RIE 

Righi  Interface  Engineering,  Inc. 

ROC 

receiver  operating  characteristic 

RPA 

Rotorcraft  Pilot’s  Associate 

S&T 

Science  and  Technology 

SA 

situational  awareness 

SAIC 

Science  Applications  International  Corporation 

SC4 

Surrogate  digital  Command,  Control,  Communications,  and 
Computer 

SCO 

Santa  Cruz  Operation 

SEP 

System  Enhancement  Program 

SEQUAM 

Sensorial  Quality  Assessment 

SIGSOET 

Special  Interest  Group  on  Software  Engineering  (ACM) 

SINCGARS 

Single-Channel  Ground  and  Airborne  Radio  System 

SME 

subject  matter  expert 

SMI 

soldier-machine  interface 

SRS 

software  requirements  specification 

SPAWAR 

Space  &  Naval  Warfare  Systems  Command  (U.S.  Navy) 

SRS 

Software  Requirements  Specification 

SSGRR 

(Conference  of)  Scuola  Superiore  G.  Reiss  Romoli 

STANAG 

Standardization  Agreement  (NATO) 

STWM 

short-term  working  memory 

T&E 

test  and  evaluation 

TACOM 

U.S.  Army  Tank- automotive  and  Armaments  Command 

TARDEC 

Tank- Automotive  Research,  Development,  and 

Engineering  Center 

TBM 

Theater  Battle  Management 
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TLX 

Task  Load  Index  (NASA) 

TM 

Technical  Manual 

TOCHI 

Transactions  on  Computer-Human  Interaction 

TR 

Technical  Report 

TTO 

Tactical  Technology  Office  (DARPA) 

TTP 

tactics,  techniques,  and  procedures 

TVAS/HMD 

Tactical  Voice  Activation  System/Helmet-Mounted 
Display 

UA 

Unit  of  Action 

UA 

unit  of  action  (U.S.  Army) 

UAV 

unattended  air  vehicle 
unmanned  aerial  vehicle 

UE 

unit  of  employment  (U.S.  Army) 

UIST 

User  Interface  Software  and  Technology 

UGV 

unmanned  ground  vehicle 

UFA 

Usability  Professionals’  Association 

use 

University  of  Southern  California 

VBAP 

Voice-Band  Audio  Processor 

VCR 

videocassette  recorder 

VTC 

video  teleconferencing 

VTT 

Vehicle  Technology  Testbed 

WMD 

weapons  of  mass  destruction 

WMI 

Warfighter-Machine  Interface 

WWW 

World  Wide  Web 
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Note  1  for  Table  A-1 :  Methods  involve  both  participant(s)  (P)  and  investigator  (I),  who  may  be  a  designer,  scientist,  or  engineer.  Advantages  and 
disadvantages  listed  are  not  necessarily  limited  to  a  given  method.  For  instance,  any  method  involving  groups  is  susceptible  to  group  dynamics,  and  any 
method  involving  presence  of  investigator  is  susceptible  to  bias  and/or  demand  characteristics. 
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Table  A-1.  Summary  of  Methods  for  Understanding  Users^  (Continued) 
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Table  A-1.  Summary  of  Methods  for  Understanding  Users^  (Continued) 
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Table  A-1.  Summary  of  Methods  for  Understanding  Users^  (Continued) 
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Table  A-1.  Summary  of  Methods  for  Understanding  Users^  (Continued) 
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